-- Logs begin at Wed 2022-08-24 14:00:28 UTC, end at Wed 2022-08-24 15:13:45 UTC. -- Aug 24 14:34:32.033990 dv-cinder-848899-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 14:34:32.042718 dv-cinder-848899-4-smb devstack@keystone.service[88254]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 14:34:32 2022] *** Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: nodename: dv-cinder-848899-4-smb Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: machine: x86_64 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: clock source: unix Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: pcre jit disabled Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: detected number of CPU cores: 4 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: current working directory: / Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: detected binary path: /usr/bin/uwsgi-core Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: your processes number limit is 47680 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: your memory page size is 4096 bytes Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: detected max file descriptor number: 2048 Aug 24 14:34:32.048201 dv-cinder-848899-4-smb devstack@keystone.service[88254]: lock engine: pthread robust mutexes Aug 24 14:34:32.052451 dv-cinder-848899-4-smb devstack@keystone.service[88254]: thunder lock: enabled Aug 24 14:34:32.052451 dv-cinder-848899-4-smb devstack@keystone.service[88254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 14:34:32.052451 dv-cinder-848899-4-smb devstack@keystone.service[88254]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 14:34:32.089611 dv-cinder-848899-4-smb devstack@keystone.service[88254]: Python main interpreter initialized at 0x55c5250539c0 Aug 24 14:34:32.089611 dv-cinder-848899-4-smb devstack@keystone.service[88254]: python threads support enabled Aug 24 14:34:32.089611 dv-cinder-848899-4-smb devstack@keystone.service[88254]: your server socket listen backlog is limited to 100 connections Aug 24 14:34:32.089611 dv-cinder-848899-4-smb devstack@keystone.service[88254]: your mercy for graceful operations on workers is 90 seconds Aug 24 14:34:32.089935 dv-cinder-848899-4-smb devstack@keystone.service[88254]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 14:34:32.090017 dv-cinder-848899-4-smb devstack@keystone.service[88254]: *** Operational MODE: preforking *** Aug 24 14:34:32.090297 dv-cinder-848899-4-smb devstack@keystone.service[88254]: *** uWSGI is running in multiple interpreter mode *** Aug 24 14:34:32.090297 dv-cinder-848899-4-smb devstack@keystone.service[88254]: spawned uWSGI master process (pid: 88254) Aug 24 14:34:32.090505 dv-cinder-848899-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 14:34:32.092689 dv-cinder-848899-4-smb devstack@keystone.service[88254]: spawned uWSGI worker 1 (pid: 88268, cores: 1) Aug 24 14:34:32.093517 dv-cinder-848899-4-smb devstack@keystone.service[88254]: spawned uWSGI worker 2 (pid: 88269, cores: 1) Aug 24 14:34:32.093517 dv-cinder-848899-4-smb devstack@keystone.service[88254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 14:34:36.445343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:34:36.445343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: from cryptography.utils import int_from_bytes Aug 24 14:34:36.446108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:34:36.446108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: from cryptography.utils import int_from_bytes Aug 24 14:34:36.452456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:34:36.452456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: from cryptography.utils import int_from_bytes Aug 24 14:34:36.452974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 14:34:36.452974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: from cryptography.utils import int_from_bytes Aug 24 14:34:36.500969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:34:36.501159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:34:36.501353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] command line args: [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:34:36.501617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:34:36.501794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ================================================================================ {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:34:36.502047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] admin_token = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.502290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] config_dir = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.502477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.502607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 14:34:36.502685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] config_source = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.502804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 14:34:36.502881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] debug = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.502998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] command line args: [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 14:34:36.503081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.503259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 14:34:36.503381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.503481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ================================================================================ {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 14:34:36.503575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.503679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] admin_token = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.503774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.503897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] config_dir = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] config_source = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_config_append = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] debug = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.504995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_dir = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_file = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.505886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_config_append = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_dir = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_file = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.506940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.507974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] publish_errors = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.508961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509421 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.509910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] standard_threads = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] publish_errors = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.510939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] use_journal = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] use_json = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] use_stderr = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] use_syslog = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.511997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] standard_threads = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.512074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.512226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.512307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.512470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.512549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.512647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.512808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.512886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] use_journal = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.513020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] use_json = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.513095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.513195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] use_stderr = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.513357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.513440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] use_syslog = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.513516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.513586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 14:34:36.513735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.513831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.513981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514058 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.514948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.515921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.516926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.517960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.518875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.519895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.520980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.521901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.522943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.523915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.524029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.524141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.524249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.524361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.525897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.526984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.527857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.528884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.533980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.534934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.535958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.536930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.537991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.external = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.538989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.password = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] auth.token = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.external = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.539986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.540062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.540796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.password = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] auth.token = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.541989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.542915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.543942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.544986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545247 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.545961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.546961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.547999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.548960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.549905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.550909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.551977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.552924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.553976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.554893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.555989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.556793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.562958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.563966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.564951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.565952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.566940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.567942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.568919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.569995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] role.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] role.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.570930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] role.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.571909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] role.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.572973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.573834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.574980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.575972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.576967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.577896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.578855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.579941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.580977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.581930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.connection = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.582893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.583984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.connection = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.584956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.585912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:34:36.586715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.586832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.587596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.587947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.588284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.588522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.588791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.589034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 14:34:36.589207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 14:34:36.619556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.619788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.620013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.621036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.621275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.621507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.628611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.631325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.659656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.659884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.661850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.662085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.720231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.720424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.768825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.769057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.769862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.770100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.933908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.934128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.934276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.934357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.934653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.935087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.965866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.966507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.977985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.978109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.990573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.990804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.990888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.991935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88269) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:36.992053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88268) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 14:34:37.015181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.015309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.015393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:34:37.015471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:34:37.015724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.015809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.015925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:34:37.016010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 14:34:37.016200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.016459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.016540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.016765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.016995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.017076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.017260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.017338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027421 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.027980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.028158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.035016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.035232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.037969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.038163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.038247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.038454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.038542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.038750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.038831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.039949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.040433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.040583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.040759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.040915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.041001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.041075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.041147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.063934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.064203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.065440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.065714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.065798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.066004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.070353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.070640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.070737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.070957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.071043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.071311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.077954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.078207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.078290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.078504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.082281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.082578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.082665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.082857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.082938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.083949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.084030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.084211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.084293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.084493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.101892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.102131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.102256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.102449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.106268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.106459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.109490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.109712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.109796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.110019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.113947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.114259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.117082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.117486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.120944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.121247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.121530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.121620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.121811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.121894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.122103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.122185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.122403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.122486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.122697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.123051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.138830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.139125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.139394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.139489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.139694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.139811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.139975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.140245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.146582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.147134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.148112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.148402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.148670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.148980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.151293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.151577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.151674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.151870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.151954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.152168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.152250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.152458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.152540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.152818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.163692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.163972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.164160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.164248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.164452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.164534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.164756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.164841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.165986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.181260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.183626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.184458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.186629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.187342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.188797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.189554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.190266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.190551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.190854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.191045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.192554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.192868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.193161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.198224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.201457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.201545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.201737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.202566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.202891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.203177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.203465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.204861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.205164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.205463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.205753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.211408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.211700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.212009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.213873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.214172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.214459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.219171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88269) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.219456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.219738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.220110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.220326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.220611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.220914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.221187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.221476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.221640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88268) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 14:34:37.221752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.221931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88269) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.222870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.223076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.223356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.223630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.223921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.224197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.224472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.224775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.225049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.225315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88268) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 14:34:37.257078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5250539c0 pid: 88269 (default app) Aug 24 14:34:37.261128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c5250539c0 pid: 88268 (default app) Aug 24 14:34:37.261263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde322-53a7-4879-8ca7-e90703994028 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:37.261524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde322-53a7-4879-8ca7-e90703994028 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:37.261799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fde322-53a7-4879-8ca7-e90703994028 None None] PATH_INFO: `/v3` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:37.265918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Aug 24 14:34:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:44.639332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:44.639818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:44.639818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:44.644098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:44.651129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:44.651572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:44.651659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:44.722386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: INFO dbcounter [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] Registered counter for database keystone Aug 24 14:34:44.742192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG oslo_db.sqlalchemy.engines [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:34:44.748618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writer thread running {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:34:44.931916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG passlib.handlers.bcrypt [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88269) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 14:34:44.932251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG passlib.handlers.bcrypt [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88269) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 14:34:44.987135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:44.988765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:45.124230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 14:34:45.565112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:45.634592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: INFO dbcounter [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] Registered counter for database keystone Aug 24 14:34:45.655985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG oslo_db.sqlalchemy.engines [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 14:34:45.662091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writer thread running {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 14:34:45.783288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38c8ed-0500-4618-8a7c-f5b3dde9ff8b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:45.787404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:45.788035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:45.788313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:45.788585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:45.797610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:45.848896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 14:34:45.849238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046652c-f471-4eb0-9122-7ce2887e37eb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:45.859232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 24 14:34:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:34:45.865324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:45.880500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a25d3-75c1-487c-9c46-5a884f7e5990 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:45.885173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:45.886213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:45.886494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:45.886765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] PATH_INFO: `/v3/projects/08e00cc0e88b4e1a866763955e5979af` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:45.888309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] RBAC: Authorizing `identity:get_project(project_id=08e00cc0e88b4e1a866763955e5979af)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:45.941144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 14:34:45.941486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a890-0a1b-4af2-b04f-cc7a8e186ebe admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:45.946018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Aug 24 14:34:45 2022] GET /identity/v3/projects/08e00cc0e88b4e1a866763955e5979af => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:47.928617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34291b-ab2b-41c6-b2d0-3b52bb0d46c6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:47.929180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34291b-ab2b-41c6-b2d0-3b52bb0d46c6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:47.929180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34291b-ab2b-41c6-b2d0-3b52bb0d46c6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:47.933440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:34:47.939025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:47.939387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:47.939571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:47.959498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:47.961023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:47.969759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 14:34:48.253912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34291b-ab2b-41c6-b2d0-3b52bb0d46c6 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:48.266682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34291b-ab2b-41c6-b2d0-3b52bb0d46c6 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:48.270823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:48.271416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:48.271693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:48.271963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:48.280071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:48.281862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9469e-5300-4259-9661-d93917dcb5a8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:48.290496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 24 14:34:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:34:48.295811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:48.304894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bbbe7-b58c-4e6b-baeb-1599cabd600e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:48.309801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:48.310428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:48.310708 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:48.310979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:48.312307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:48.314432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6b80a-5e9b-4316-a23b-2622e7e49654 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:48.316045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Aug 24 14:34:48 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:50.303802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927e-bf48-43a2-92e9-c42cf093d07c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:50.304364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927e-bf48-43a2-92e9-c42cf093d07c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:50.304461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103927e-bf48-43a2-92e9-c42cf093d07c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:50.305845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:50.311271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160c14-2f2e-40cb-b00f-56acb8e720b4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:50.311711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160c14-2f2e-40cb-b00f-56acb8e720b4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:50.311939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26160c14-2f2e-40cb-b00f-56acb8e720b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:50.329841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-26160c14-2f2e-40cb-b00f-56acb8e720b4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:50.331020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-26160c14-2f2e-40cb-b00f-56acb8e720b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:50.417861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 6/11] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:50.455892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f488d-9c6e-4d62-8d34-219477a7f92b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:50.456183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f488d-9c6e-4d62-8d34-219477a7f92b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:50.456466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f488d-9c6e-4d62-8d34-219477a7f92b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:50.457836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 6/12] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:50.463854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:50.464137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:50.464409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:50.483574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:50.484788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:50.501372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:50.563913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:50.687730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f488d-9c6e-4d62-8d34-219477a7f92b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:50.832504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f488d-9c6e-4d62-8d34-219477a7f92b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:50.865654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:50.866506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:50.866785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:50.867057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:50.870882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:50.880008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:34:50.888849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:34:50.889939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:34:50.890903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:34:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:34:50.895655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:50.932840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:50.978048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536269f5-3dc9-4212-afaf-38c2eafa9a7b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.010830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaddf95-bf5c-47fa-9810-53e2e9866a53 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.014452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.015067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.015340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.015607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.045985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:51.049715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.050601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.050885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.051161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.051895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:51.052158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.065790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.087909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:34:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:51.093023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.094604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:51.094756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.192473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:34:51.193731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:51.198512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:51.199583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b130f1-a20c-4646-8250-71c029cf7ba5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.234656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.235290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.235569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.235843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.237449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.238911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.240499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:34:51 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:51.246320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:51.250580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:51.300115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73447-0b58-48a6-81fc-6da6328fc126 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.333827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.334462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.334710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.334979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.346853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.348198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a64f4-0871-4750-a237-e4fcba6e53f0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.348588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:34:51.365732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:34:51.366635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:34:51.367512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:34:51.367512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:34:51.367512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:34:51.367512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:34:51.373056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:51.403343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.404468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.404769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.405047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.406354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.407824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.409947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:51.416478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:51.448607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:51.481640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec472f9-b196-4f62-b3a7-f9d6573bda42 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.484039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:51.516582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.517268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.517801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.518296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.518979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:51.519632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.520053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b3c201-3b51-4a65-b1f8-7106239f7944 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:51.521225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6db9-9fc7-4585-bbc1-30f06690586d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.541454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 10/20] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:34:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:51.556613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:51.557283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:51.557566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:51.557843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:51.558610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.domain.id=default, user.id=82ed3163243941a487c9161b1c295ce7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:51.558921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:51.560449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d16d8e-f3fd-463c-adca-df144422d310 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:51.570433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 11/21] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 24 14:34:51 2022] GET /identity/v3/role_assignments?user.id=82ed3163243941a487c9161b1c295ce7&scope.domain.id=default&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:53.872528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04d0-6eaa-4433-8327-4ee2894a742f None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:53.873447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04d0-6eaa-4433-8327-4ee2894a742f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:53.873857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab04d0-6eaa-4433-8327-4ee2894a742f None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:53.875323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 11/22] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:53.880833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:53.881593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:53.882005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:53.905986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG passlib.handlers.bcrypt [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88268) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 14:34:53.906637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG passlib.handlers.bcrypt [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88268) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 14:34:53.961186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:53.963549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-53a88cc5-d234-4e58-bf27-d8b1744ed00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:53.983073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d265-47bb-4d23-801f-fcba8c8b2c3a None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:53.983599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d265-47bb-4d23-801f-fcba8c8b2c3a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:53.984010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1d265-47bb-4d23-801f-fcba8c8b2c3a None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:53.985491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 12/23] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:53.991591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba213-2fda-4b5c-bdcb-3f9481d5bdf5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:53.992111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba213-2fda-4b5c-bdcb-3f9481d5bdf5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:53.992589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba213-2fda-4b5c-bdcb-3f9481d5bdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.022694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-683ba213-2fda-4b5c-bdcb-3f9481d5bdf5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:54.024746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-683ba213-2fda-4b5c-bdcb-3f9481d5bdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:54.130491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 12/24] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:34:54.148270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 13/25] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:34:54.420306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ed5-e810-446e-a2ba-761fb637e741 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.420940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ed5-e810-446e-a2ba-761fb637e741 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.421420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ed5-e810-446e-a2ba-761fb637e741 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.423191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 13/26] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:54.428881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d53f0-f2d9-4782-8f4e-91c1e8c5f06b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.429420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d53f0-f2d9-4782-8f4e-91c1e8c5f06b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.429882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d53f0-f2d9-4782-8f4e-91c1e8c5f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.458508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0b9d53f0-f2d9-4782-8f4e-91c1e8c5f06b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:54.459993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0b9d53f0-f2d9-4782-8f4e-91c1e8c5f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:54.515887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5ed5-e810-446e-a2ba-761fb637e741 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:54.571043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:54.576305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 14/27] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:34:54.577614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a257c-dd08-4d96-9dea-6ff116a9815f None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.577902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a257c-dd08-4d96-9dea-6ff116a9815f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.578171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a257c-dd08-4d96-9dea-6ff116a9815f None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.579413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 15/28] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:54.594363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.594852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.595287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.620506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:54.621987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:54.642670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:54.703674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 16/29] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:54.704833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:54.729970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5ed5-e810-446e-a2ba-761fb637e741 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:54.790945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:54.791592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.791873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.792146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.824407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db7862-9951-4fe4-ac0b-f7c1c3201d31 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:54.829768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:54.831315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:34:54.859765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:34:54.860895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:34:54.861950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:34:54.861950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:34:54.861950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:34:54.864989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 14/30] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:34:54.865545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:54.866341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:54.866758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:54.867173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:54.875351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:54.897422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:34:54.904195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:34:54.905081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:54.905824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:34:54.913910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 17/31] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:34:54.922493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:54.965546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.032363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.057518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aac319e-b85d-47bc-bcdc-a2b520fa018b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.082128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0536bea-f73e-469f-b3e6-909c83f1dfd9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.101871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.103032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.103329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.103562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.104216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:55.104515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.105934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.125489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 15/32] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:55.128885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:55.132702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.133339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.133642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.135349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.135467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:55.135754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.137241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.150083 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 18/33] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:55.151049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:55.235389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.256634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f293e-8b2e-430c-af02-97a88c76ffac None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.259037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f727c-50f9-40e8-8e07-00cf77f74e6e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.293267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.294039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.294416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.294700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.294988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.295234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.295328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.295750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.295918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.296850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.297335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.298557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.417041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.503368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 19/34] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 14:34:55 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:55.504255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:55.534260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 16/35] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 14:34:55 2022] POST /identity/v3/roles => generated 219 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:55.535718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:55.641655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5546e-12d1-4869-b358-09bc1be4602b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.685861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.686508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.686795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.687075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.687752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.689573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79c249-22de-498d-a562-7fc050fcdaf1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.699339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.709062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e780a9-cbd8-4207-b560-53daaac16a0e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.754718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.754887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.755103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.755324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.757029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.759188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1424a-86af-4737-b168-92b55ec52cb0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.762220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 17/36] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:34:55 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f276c-eae4-450e-bda1-40f7e37371c6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f276c-eae4-450e-bda1-40f7e37371c6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f276c-eae4-450e-bda1-40f7e37371c6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 18/37] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17694-1610-4abb-824f-d5bfd39ed680 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.769917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17694-1610-4abb-824f-d5bfd39ed680 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.770424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e17694-1610-4abb-824f-d5bfd39ed680 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.771107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 19/38] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:55.771657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e17694-1610-4abb-824f-d5bfd39ed680 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:55.793331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 20/39] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:34:55 2022] POST /identity/v3/projects => generated 301 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:55.794806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cead3-40f1-47fa-9e2a-023deb59ecc1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.795313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cead3-40f1-47fa-9e2a-023deb59ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.795416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cead3-40f1-47fa-9e2a-023deb59ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.816483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e53cead3-40f1-47fa-9e2a-023deb59ecc1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:55.818265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e53cead3-40f1-47fa-9e2a-023deb59ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:55.862419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:55.908946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e17694-1610-4abb-824f-d5bfd39ed680 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:55.921002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 21/40] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:55.921002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.921002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.921002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.956381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:55.957162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:55.957431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:55.957714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:55.959124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:55.960843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:55.963415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 20/41] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:55.969612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:56.048986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:56.050116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:56.090380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74876dc-ed59-4ec2-b45f-9f69fa2b478a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:56.125910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:56.126578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:56.126849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:56.127159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 22/42] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:56.129095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] PATH_INFO: `/v3/domains/default/users/82ed3163243941a487c9161b1c295ce7/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:56.131111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=82ed3163243941a487c9161b1c295ce7, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:56.132563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:56.134928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:56.193858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:56.232078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Aug 24 14:34:55 2022] PUT /identity/v3/domains/default/users/82ed3163243941a487c9161b1c295ce7/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:34:56.250461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:56.310375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea17ce9-7489-4c7b-9e2d-e2d25b00f913 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:56.348107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:56.348772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:56.349063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:56.349343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:56.350024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:56.351459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:56.399819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:56.422391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 14:34:56 2022] POST /identity/v3/roles => generated 223 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:34:56.516392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf8fee-64ef-45f2-a2c6-e6e772594c82 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:56.554905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:56.555592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:56.555877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:56.555877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:56.557291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:56.558755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca91312-5fe8-4b0c-9881-d2affe4365eb None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:56.560825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 22/45] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:56.566160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:56.679678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8f9cd-48f9-4489-873b-d9b5fe7c4a36 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:56.689662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:56.714744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:56.715358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:56.715637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:56.715907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:56.716560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:56.718049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0750862-bb5f-4764-bf91-eb87efdfb5e7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:56.804860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:34:56 2022] POST /identity/v3/projects => generated 312 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:34:58.177223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe538-58be-4fa6-86f5-3c3147f12b2a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.178380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe538-58be-4fa6-86f5-3c3147f12b2a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.178380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfe538-58be-4fa6-86f5-3c3147f12b2a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.179130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 23/47] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:34:58.185139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.185555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.185814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.203928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:58.205176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:58.271111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:34:58.543309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe538-58be-4fa6-86f5-3c3147f12b2a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:58.607001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:58.647414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfe538-58be-4fa6-86f5-3c3147f12b2a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:58.680173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:58.681408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.681686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.681957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.692549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-64f4a33f-9e50-4705-82f9-733d988d590d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:34:58.698545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:34:58.699386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:34:58.700130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 24/49] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:34:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:34:58.705641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:58.708803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dda980-42b0-443c-826a-dcdca53fc2af None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.709091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dda980-42b0-443c-826a-dcdca53fc2af None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.709365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dda980-42b0-443c-826a-dcdca53fc2af None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.710808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 25/50] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:34:58.715566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.715849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.716122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.734170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:34:58.735683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:34:58.798228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:58.801448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 26/51] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:34:58.808292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55285fb9-4b84-4283-83a5-69610a05f866 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:58.842451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:58.843054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.843333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.843602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.844518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:58.844887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:58.846242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:58.855696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 26/52] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:34:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:58.860393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:58.911724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:58.958138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946bf82-8b0f-4a0b-bbb5-896fd40bbd75 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:58.991253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:58.991880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:58.992157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:58.992428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:58.994190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:58.995643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:58.997248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 27/53] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:34:58 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:34:59.002789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:59.069513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:59.101769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217071d-8eb2-432c-a996-03ed5bab4c08 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:59.135070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:59.135816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:59.136110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:59.136377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:59.137533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:59.138999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:59.140570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 27/54] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:59.146241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:59.167172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c3b9d-fe84-49d9-888d-aad21b7c7253 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:59.168251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:59.188281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:34:59.201815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:59.202443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:59.202718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:59.203000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:59.204100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:59.205666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:59.207520 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:34:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:59.213462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:34:59.246955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d135d06-bbb0-46e1-a925-42e58c5868e9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:59.283058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:59.283693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:59.283985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:59.284264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:59.285054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.domain.id=default, user.id=82ed3163243941a487c9161b1c295ce7) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:34:59.285374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:59.286870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7af3e-f341-4a3d-bf0d-9ee8cb34cb67 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:59.295863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 28/56] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 24 14:34:59 2022] GET /identity/v3/role_assignments?user.id=82ed3163243941a487c9161b1c295ce7&scope.domain.id=default&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:34:59.425544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d0af1-afad-4e53-be78-fd0907738c7c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:34:59.461191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:34:59.462399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:34:59.462717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:34:59.462933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:34:59.463585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:34:59.465062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19335f4-c041-425e-9832-a4d35f715846 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:34:59.548353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 29/57] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 24 14:34:59 2022] POST /identity/v3/projects => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:35:01.458007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b937db-2d89-436e-8000-fb215964c5de None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:01.458527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b937db-2d89-436e-8000-fb215964c5de None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:01.458606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b937db-2d89-436e-8000-fb215964c5de None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:01.459905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 29/58] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:01.465757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:01.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:01.466307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:01.484565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:01.485764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:01.519033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:01.550275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:01.824205 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b937db-2d89-436e-8000-fb215964c5de None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:01.908202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:01.924749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b937db-2d89-436e-8000-fb215964c5de None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:01.958354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:01.958979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:01.959259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:01.959530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:01.960640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:01.962246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632ac0-9c17-43d7-a959-69587e605a79 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:01.963805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 30/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:01.969613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:02.066115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3eb2e-f787-44b8-b828-0b90d73e8dfd None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:02.099011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:02.099619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:02.099903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:02.100184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:02.100856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:02.102987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd5cc8-41cc-4eca-b20a-c80eceef200f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:02.219815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 31/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:01 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:05.214966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f40ef-130f-468f-9ed9-b477d17cd16f None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.215965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f40ef-130f-468f-9ed9-b477d17cd16f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.216451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f40ef-130f-468f-9ed9-b477d17cd16f None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.218376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:05.223664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2c0a-c6ba-4be0-9b31-04df8927ca1e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.224455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2c0a-c6ba-4be0-9b31-04df8927ca1e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.224954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e2c0a-c6ba-4be0-9b31-04df8927ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.253773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e20e2c0a-c6ba-4be0-9b31-04df8927ca1e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:05.255330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e20e2c0a-c6ba-4be0-9b31-04df8927ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:05.274289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bfdbf-5121-4728-9181-302776a7dc87 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.274990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bfdbf-5121-4728-9181-302776a7dc87 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.275971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7bfdbf-5121-4728-9181-302776a7dc87 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.277554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:35:05.285553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:05.291403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c763f-a984-4a1f-8316-77179808d8b3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.292006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c763f-a984-4a1f-8316-77179808d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.292504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126c763f-a984-4a1f-8316-77179808d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.311659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-126c763f-a984-4a1f-8316-77179808d8b3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:05.313226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-126c763f-a984-4a1f-8316-77179808d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:05.359424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 32/64] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:05.446418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 33/65] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:05.576402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c1d6-1703-4be1-8cfd-2656189aaea0 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.576686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c1d6-1703-4be1-8cfd-2656189aaea0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.576907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137c1d6-1703-4be1-8cfd-2656189aaea0 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.578496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 33/66] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:05.583902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1d19-1e34-40de-b273-171155358f4f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.584417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1d19-1e34-40de-b273-171155358f4f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.584933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1d19-1e34-40de-b273-171155358f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.613782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-301d1d19-1e34-40de-b273-171155358f4f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:05.615318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-301d1d19-1e34-40de-b273-171155358f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:05.691442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137c1d6-1703-4be1-8cfd-2656189aaea0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:05.708732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 34/67] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:05.805214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1d19-1e34-40de-b273-171155358f4f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:05.834048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:05.887856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137c1d6-1703-4be1-8cfd-2656189aaea0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:05.928241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:05.929455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:05.929941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:05.930589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:05.943325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:05.950220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:05.951098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:05.951860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:05.954747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 34/68] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:05.961655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:05.984477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:05.998844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1d19-1e34-40de-b273-171155358f4f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.035101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.035730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.036015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.036285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.047339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8483eb22-cf1b-4e58-875e-62454cd6f736 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:06.052075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:06.053044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:06.053813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 35/69] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:06.056349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8dde0-284f-4efc-9ede-dac3d44c87a3 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.056681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8dde0-284f-4efc-9ede-dac3d44c87a3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.057156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8dde0-284f-4efc-9ede-dac3d44c87a3 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.058459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 36/70] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:06.061516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8dde0-284f-4efc-9ede-dac3d44c87a3 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.076163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a406d34-567e-4241-be9e-c232f367baaf None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.110366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.110903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.111180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.111453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.112117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:06.112426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.113851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c797b1-1c3c-454b-b7d8-3c8a651fae34 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.122212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.123275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f3d2-9938-4d73-b144-35324de1f54c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.123542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f3d2-9938-4d73-b144-35324de1f54c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.123819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1f3d2-9938-4d73-b144-35324de1f54c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.125045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 36/72] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:06.128838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f3d2-9938-4d73-b144-35324de1f54c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.137805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.168045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8dde0-284f-4efc-9ede-dac3d44c87a3 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.201821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.202498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.202727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.203001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.206033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.213483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5986da41-c77d-48f0-baf5-c24322278750 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:06.218143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:06.219951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:06.220705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f997e8-35d6-4660-9b39-5bc45817313a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.221404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f997e8-35d6-4660-9b39-5bc45817313a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.221404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f997e8-35d6-4660-9b39-5bc45817313a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.234679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1f3d2-9938-4d73-b144-35324de1f54c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.238388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-52f997e8-35d6-4660-9b39-5bc45817313a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:06.239583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-52f997e8-35d6-4660-9b39-5bc45817313a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:06.273954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.274719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.276390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.276671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.277384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:06.277691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.279098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.288593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 37/74] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.292332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.321371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 38/75] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:06.323576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.323860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.324134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.349299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:06.350550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:06.403923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b44f36-4dfa-46d6-a6b4-92074c3251ee None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.414236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.425273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 39/76] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:06.426002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.453485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.454848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.455754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.456494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.458557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.460519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.463763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 38/77] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.464789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.478235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.553130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edddcad-1a76-495b-941c-47179fdeb636 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.584637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0c8c4-ab6f-4d06-86e2-254243aab5a2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.592957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.593614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.593904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.594445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.595170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:06.595479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.596895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.605633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 40/78] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.606526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.643735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.644647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.644959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.645223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.662548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.664260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.666408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 39/79] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.671750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.676198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.725525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ab6e4-4706-4000-8354-82d9d31ab193 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.740728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.759687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.760464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.760776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.761135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.775521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a325b3a-983d-4115-ba50-5d3d1085788c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.810008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.810635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.810915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.811186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.812291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.813773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.815333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 40/80] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.816086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.831693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.833280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.890414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:06.914781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ba5ec-9b7e-47fa-962e-940efb195852 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:06.935766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 41/81] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:06.936519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.951196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:06.951832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:06.952117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:06.952396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:06.953571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:06.955028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:06.956588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 41/82] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:06.960099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:06.963547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.042630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79b1b-fa15-4618-84ba-8a76fdddf26d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.067839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94688ecb-4441-4e07-a7db-12ccc4a6230e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.077252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.077866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.078147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.078423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.102292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.103449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.104075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.104355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.104633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.114570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:07.120439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:07.121345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:07.122096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 42/83] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:07.123669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.149204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.150903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.185677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.223967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a35b1d-0e00-42f8-9cf3-853020e89fe1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.250414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 42/84] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:07.251822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.264528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.265172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.265451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.265726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.266368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.267810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.305308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.353287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 43/85] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:07 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:07.354150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.354610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997a8b6-baca-4943-97a9-9d41e8698a9c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.403676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.404333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.404608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.404913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.406144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.407969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.415693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 43/86] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:07.416598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.486392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e22289-65e6-48bb-a541-1070fbcef13d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.510881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.527602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e1e5d0-41bd-47f5-8daf-c7570fa52e4e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.533582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.534930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.534930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.534930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.558670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.575000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.575613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.576258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.576258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.576855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:07.577164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.578571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.587184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 44/87] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:07.588045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.612758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.614323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.752135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 44/88] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:07.753028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.762676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0b4f6-7c15-4657-af8a-5dc719a6a6aa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.773231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.804381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.805047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.805327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.805602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.807682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.809792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.811806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 45/89] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:07.812578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:07.877562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:07.884167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f9b64-cb4a-4f2a-8ad6-00ea99b84c70 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.931705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df9e2c-b10a-4bbd-ab61-5d6821d19031 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:07.932310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:07.932564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:07.936738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:07.936738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:07.936738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=82ed3163243941a487c9161b1c295ce7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:07.936738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:07.936738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:07.943980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 45/90] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/role_assignments?user.id=82ed3163243941a487c9161b1c295ce7&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:07.944834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.021671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.022252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.022532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.022873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.024157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.026626 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.028263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 46/91] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:08.029256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.038734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:08.067765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d729-0097-4854-bb14-331e752e0d8a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.142223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.142872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.143151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.143426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.145275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.146737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.148793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 46/92] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:07 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:08.149451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.246902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108461e-8ff3-48bc-8f0b-f2381504da19 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.262528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b83f9-3a1b-48c2-8889-abcf4e048758 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.289003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:08.301603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.302216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.302499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.302772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.323504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:08.326894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.327517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.327803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.328081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.328853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:08.329172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.330717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.345460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 47/93] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:08 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 259 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:08.346310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.389307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.391077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.510182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 47/94] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:08.516203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.578218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:08.621366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a9c49-845c-4140-9c01-cb1f8cfc8527 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.629301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d741682-68da-4e0d-8a8d-8ed54d00b304 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.666673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.667532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.667906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.668275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] PATH_INFO: `/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.669693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] RBAC: Authorizing `identity:get_project(project_id=560a3f3f41c34d4da654401fbd9dfeb2)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.671274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.673052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 48/95] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:08 2022] GET /identity/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:08.679041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:08.700469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.701134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.701415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.701692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.702441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:08.702751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.704300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384259d-a455-4c1a-b272-a768b9b83785 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.714939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 48/96] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:08 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 259 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:08.791908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4dabb-d28c-4fc2-b368-edc0965741bc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:08.810297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:08.837145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:08.837145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:08.837145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:08.837145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:08.838411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=560a3f3f41c34d4da654401fbd9dfeb2, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:08.838411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:08.838411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff4744-e7b9-4c9b-96cb-d86054f35a3d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:08.839467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 49/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:08 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=560a3f3f41c34d4da654401fbd9dfeb2&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:10.220446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619284-7512-4342-8879-ad754666e9ca None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:10.220446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619284-7512-4342-8879-ad754666e9ca None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:10.220446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78619284-7512-4342-8879-ad754666e9ca None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:10.220446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 49/98] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:10.226938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e9ae-2f9b-4770-b9e3-41899ada123b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:10.227797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e9ae-2f9b-4770-b9e3-41899ada123b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:10.229076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e9ae-2f9b-4770-b9e3-41899ada123b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:10.251356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9126e9ae-2f9b-4770-b9e3-41899ada123b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:10.252877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9126e9ae-2f9b-4770-b9e3-41899ada123b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:10.340380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 50/99] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:10.450021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334536-837b-40cf-97fb-cc6f99dc25c2 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:10.450338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334536-837b-40cf-97fb-cc6f99dc25c2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:10.450608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334536-837b-40cf-97fb-cc6f99dc25c2 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:10.452058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 50/100] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:10.457437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:10.457730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:10.458011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:10.484391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:10.485550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:10.569931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 51/101] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:10.868244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334536-837b-40cf-97fb-cc6f99dc25c2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:10.929048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:10.990338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334536-837b-40cf-97fb-cc6f99dc25c2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:11.003339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.038494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:11.039541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.039989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.040434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.045796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:11.047441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:11.050042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 51/102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:11.055663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.097448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:11.234145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9743c-0bf3-4dab-9e61-27422acdd9a9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:11.240383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef918e8-7a02-4c2a-81d2-a41b1ad31bbe None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:11.260697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:11.280423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:11.281109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.281324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:11.281436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.281648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.281950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.282231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.282501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.283150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:11.284597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef006e-5f58-4408-a697-d26543c56157 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:11.292882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-05242821-811f-4a02-b771-e0a94c9a0b2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:11.297965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:11.298799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:11.299567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 52/103] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:11.300777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa7ea-630a-4529-8be9-a2da37885c00 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.300777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa7ea-630a-4529-8be9-a2da37885c00 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.300937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fa7ea-630a-4529-8be9-a2da37885c00 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.304885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 53/104] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:11.304885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb12e7-6268-4787-b25e-a6487aabc1ff None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.304885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb12e7-6268-4787-b25e-a6487aabc1ff None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.304885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb12e7-6268-4787-b25e-a6487aabc1ff None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.305320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 54/105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:11.306369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1c0f-b84e-4cb5-a41d-a1fa7632fd32 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.306649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1c0f-b84e-4cb5-a41d-a1fa7632fd32 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.306923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d1c0f-b84e-4cb5-a41d-a1fa7632fd32 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.308141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 55/106] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:11.308853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d1c0f-b84e-4cb5-a41d-a1fa7632fd32 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.392302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 52/107] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:35:11 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:11.392302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e80a0-ec7e-4840-80d9-85d0bf9ef210 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.392302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e80a0-ec7e-4840-80d9-85d0bf9ef210 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.392302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e80a0-ec7e-4840-80d9-85d0bf9ef210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.408076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5b8e80a0-ec7e-4840-80d9-85d0bf9ef210 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:11.409446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5b8e80a0-ec7e-4840-80d9-85d0bf9ef210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:11.429643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d1c0f-b84e-4cb5-a41d-a1fa7632fd32 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:11.432439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:11.483541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:11.484518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.485319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.485612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.486636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:11.486950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:11.489311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9613726-2fcc-43fe-aa64-5074ecc618f5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:11.493150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 53/108] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:11.495101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.495484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.496122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.500881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 56/109] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:11.502158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73596c-cfb9-4664-b1d5-6bdddfbcf660 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.502441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73596c-cfb9-4664-b1d5-6bdddfbcf660 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.502737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73596c-cfb9-4664-b1d5-6bdddfbcf660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.523385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:11.524575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:11.533150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0b73596c-cfb9-4664-b1d5-6bdddfbcf660 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:11.535101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0b73596c-cfb9-4664-b1d5-6bdddfbcf660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:11.607267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:11.608038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.635104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 57/111] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:11.637001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346079-2964-4c5c-a9dc-ce6c4ea06d8d None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.637408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346079-2964-4c5c-a9dc-ce6c4ea06d8d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.637704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346079-2964-4c5c-a9dc-ce6c4ea06d8d None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.639416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 58/112] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:11.640697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:11.645639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.645923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.646199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.674943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:11.676145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:11.757531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 59/113] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:11.812423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe931fe-6378-4ca2-a3c6-03de1bdde3b0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:11.861627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:11.862493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:11.862911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:11.863347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] PATH_INFO: `/v3/users/f65647a0349f4625be96d0c320826514` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:11.881234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] RBAC: Authorizing `identity:get_user(user_id=f65647a0349f4625be96d0c320826514)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:11.882875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:11.885718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 55/114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:11 2022] GET /identity/v3/users/f65647a0349f4625be96d0c320826514 => generated 289 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:11.890887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.891502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:11.945116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.042868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def5baa-0cb8-4269-8bc1-0db5d933fcd2 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.065287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.088149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45e24e-f1b1-4ab7-b926-bc16601ef2fa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.098295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.098951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.099237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.099833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.113433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:12.118166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:12.119044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:12.119796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 60/115] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:12.120404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.129591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.130210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.130490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.130761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.209244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.209846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.211958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.225933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67523e6-8a37-4bcf-88a2-735c6b1c3e84 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.262629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.263292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.263518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.263791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.275364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:12.280138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:12.281001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:12.281882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 61/116] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:12.283119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.314290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.334742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 56/117] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:12.336055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.396072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4cbcd-2891-497f-b297-2260b91861f7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.430214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.430848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.431694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.431972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.442306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:12.447715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:12.448531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:12.449327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 62/118] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:12.449938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.454802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.456037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c0ca6-42c1-4549-8ca6-d529e5634826 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.493323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.494992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.495269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.495537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.507775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:12.513554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:12.514383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:12.515138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 57/119] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:12.515764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.558162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55c168-4f17-4f3c-a2c0-db93491555be None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.569490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.593012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.593618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.593900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.594171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.595101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:12.595401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.596834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.605180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 63/120] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:12.605771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.689307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d4fe-e9f4-4862-91d8-f850829f2215 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.722390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.730925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.731618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.731956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.732233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.732932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:12.733234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.737912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.744205 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 58/121] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:12.745090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.761075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13a532-cac6-4bb4-8ba4-b4249eba1126 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.796986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.797623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.797960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.798240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.799392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.800864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.802495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 64/122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:12.803249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.861882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b485e3a-8629-4c2a-91a5-e2a28777a913 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.872217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.899175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.900124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.900580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.901058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.901735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:12.902043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.903435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.911615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 59/123] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:12.912515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:12.921755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3e622-3e96-41c6-b9fd-f39ba663538f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:12.956590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:12.957498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:12.957917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:12.958340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:12.959008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:12.959311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:12.960856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:12.962425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:12.970365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 65/124] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:12.975535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.023465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc177-519a-4342-93c1-9ad147ca594a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.058113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.058735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.059013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.059282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.060415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.061919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.063711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 60/125] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.064248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.087976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c25da-11e8-47dd-a44c-6f3768ce4a69 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.104365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.133592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.134817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.135169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.136345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.137066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.138621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.140499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 66/126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:12 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.141234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.169162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a12823-7ef0-4cd4-99a6-5b9321575278 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.205107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.205666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.205945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.206210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.206624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.207050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=f65647a0349f4625be96d0c320826514) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:13.207249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.208794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.214685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 61/127] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/role_assignments?user.id=f65647a0349f4625be96d0c320826514&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=696d457f88ff41989009dc2f9fb8998b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.215592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.262787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3defc37-5260-4caf-abb6-c558bfc0e7c0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.309333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.310264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.310788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.311392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.312904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.314560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.316976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 67/128] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.317991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.356968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014eb50-ef39-49f1-a32b-7d6240e862cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.359010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.409178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.409384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.409678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.409958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.411111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.413033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.415356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 62/129] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.416229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.455253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541ec41-67a4-4752-89ed-9808bd976150 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.500072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.506627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.507738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.508019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.508439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.510305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.512180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.519618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 68/130] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.519618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.532272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e236c-08f3-4f60-b4e9-8a3d38a0156e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.570066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.570872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.571314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.572228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.573530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.575363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.577375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 63/131] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.578117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.622946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.652387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b569f52-c448-4133-a4fc-6bb5cf30ec2c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.690194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7e7f4-cb9b-44ec-967c-8e8868494dca None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.700551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.701376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.701657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.702250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.703678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.705362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.707387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 69/132] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.708196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.731228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.732096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.732398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.732656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] PATH_INFO: `/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.733802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=560a3f3f41c34d4da654401fbd9dfeb2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.735257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.737180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 64/133] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:13 2022] GET /identity/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:13.737822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:13.784560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.824652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239be98d-d3fb-4835-a9b4-93c6bd293068 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.843547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc6df8-fcd9-4c15-8879-bec0860ad9c0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:13.851193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:13.870196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.871114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.871529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.871937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/2f10a52cb2974b4d8984cb32416192fa/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.874657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, user_id=2f10a52cb2974b4d8984cb32416192fa, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.876248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9905adf-97b5-4b92-87a1-c0f2f68c627e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.878301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:13.879422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.879677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.879958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/82ed3163243941a487c9161b1c295ce7/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.882005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, user_id=82ed3163243941a487c9161b1c295ce7, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:13.883451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:13.987202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 70/134] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:13 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/2f10a52cb2974b4d8984cb32416192fa/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:13.988785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67a94-9306-40f3-9b34-6be1058b2a9a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:13.989076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67a94-9306-40f3-9b34-6be1058b2a9a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:13.989352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67a94-9306-40f3-9b34-6be1058b2a9a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:13.990733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 71/135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:13.991276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67a94-9306-40f3-9b34-6be1058b2a9a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:14.004760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 65/136] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:13 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/82ed3163243941a487c9161b1c295ce7/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:14.006415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:14.137357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a121d5-bfdc-4f17-bedd-2ce677b8fee1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:14.155993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67a94-9306-40f3-9b34-6be1058b2a9a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:14.178475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:14.179280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:14.179627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:14.179977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] PATH_INFO: `/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2/users/2f10a52cb2974b4d8984cb32416192fa/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:14.182894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] RBAC: Authorizing `identity:create_grant(project_id=560a3f3f41c34d4da654401fbd9dfeb2, user_id=2f10a52cb2974b4d8984cb32416192fa, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:14.184471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ddcb6-e9e8-40e3-b133-234357291b80 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:14.200755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:14.206575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:14.207371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:14.207742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:14.208082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/2f10a52cb2974b4d8984cb32416192fa/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:14.210636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, user_id=2f10a52cb2974b4d8984cb32416192fa, role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:14.212333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:14.279589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 66/137] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:14 2022] PUT /identity/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2/users/2f10a52cb2974b4d8984cb32416192fa/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:14.280797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:14.281044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:14.281315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:14.303802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:14.305493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:14.323849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 72/138] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:13 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/2f10a52cb2974b4d8984cb32416192fa/roles/f9509a8b59544a6ca684faad78f1d96f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:14.331821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:14.389597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 67/139] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:14.769395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:14.889557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc729b-4f73-4431-addb-1d4421e4fea6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:14.926601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:14.927239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:14.927515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:14.927782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:14.928922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:14.930376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7478c7b-3c09-4383-810c-969eb9bd609c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:14.932344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 73/140] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:14.938480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:15.054829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcbb72-f4e6-42fb-a44b-0aa4cd85b302 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:15.101057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:15.101671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:15.101947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:15.102216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:15.102918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:15.104378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8799f0c-03c3-4a2c-8e4b-d85325e700cb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:15.233408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 68/141] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:14 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:15.627313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4d31-420f-4c33-a4e0-ac9b194e68ed None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:15.627811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4d31-420f-4c33-a4e0-ac9b194e68ed None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:15.627909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be4d31-420f-4c33-a4e0-ac9b194e68ed None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:15.629506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 74/142] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:15.646780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:15.646780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:15.646780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:15.666807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:15.668235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:15.676862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:15.741149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 69/143] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:16.087054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be4d31-420f-4c33-a4e0-ac9b194e68ed None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:16.153856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:16.205454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be4d31-420f-4c33-a4e0-ac9b194e68ed None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:16.249214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:16.249844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.250118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.250382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.265178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:16.269986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:16.270824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:16.271585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 75/144] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:16.277740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:16.398021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a401cb5-2c7c-45a7-b038-d7f055183b88 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:16.434164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:16.434778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.435060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.435327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.436002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:16.436302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:16.437732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:16.446785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 70/145] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:16.452440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:16.560689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996f8b4-087c-4ce2-ae0b-72a6c55e4306 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:16.579754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:16.599672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:16.600417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.600697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.600994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] PATH_INFO: `/v3/users/f65647a0349f4625be96d0c320826514` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.602132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] RBAC: Authorizing `identity:get_user(user_id=f65647a0349f4625be96d0c320826514)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:16.603762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:16.605794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 76/146] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:16 2022] GET /identity/v3/users/f65647a0349f4625be96d0c320826514 => generated 289 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:16.611274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:16.621156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:16.717795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762e138-6435-48a2-8942-a8602b32f079 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:16.752495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:16.753173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.753450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.753719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.754870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:16.756325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb3b1b-552e-4b2e-b20d-dac25f1cf530 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:16.758204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 71/147] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:16 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:16.764859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:16.870836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea1f-ffd7-4a50-84e2-3e97eb597c8d None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.871145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea1f-ffd7-4a50-84e2-3e97eb597c8d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.871371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2ea1f-ffd7-4a50-84e2-3e97eb597c8d None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.871617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f93a1-6737-4ec2-b437-7e94258673a1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:16.872704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 72/148] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:16.888891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850236c-2172-437e-9853-be88933a1417 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.889409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850236c-2172-437e-9853-be88933a1417 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.889803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850236c-2172-437e-9853-be88933a1417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.914241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3850236c-2172-437e-9853-be88933a1417 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:16.916069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3850236c-2172-437e-9853-be88933a1417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:16.925636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:16.926633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:16.927107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:16.927571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/f65647a0349f4625be96d0c320826514/roles/696d457f88ff41989009dc2f9fb8998b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:16.929789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, user_id=f65647a0349f4625be96d0c320826514, role_id=696d457f88ff41989009dc2f9fb8998b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:16.932431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5b7ff-6c99-47a2-9854-f81f1dbf03f4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:17.010029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 73/149] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:17.010952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612d9-a631-497d-bd2c-8104a266cf60 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.011235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612d9-a631-497d-bd2c-8104a266cf60 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.011620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d612d9-a631-497d-bd2c-8104a266cf60 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.013016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 74/150] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:17.018608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b9f6e-700e-4fb8-b4d4-81b06eead738 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.018880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b9f6e-700e-4fb8-b4d4-81b06eead738 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.019148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b9f6e-700e-4fb8-b4d4-81b06eead738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.026386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 77/151] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:16 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/users/f65647a0349f4625be96d0c320826514/roles/696d457f88ff41989009dc2f9fb8998b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:17.029365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:17.043195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-191b9f6e-700e-4fb8-b4d4-81b06eead738 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:17.044817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-191b9f6e-700e-4fb8-b4d4-81b06eead738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:17.131399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 75/152] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:17.365508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b817b1-1004-4107-86ec-4a3553a5ba10 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.365938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b817b1-1004-4107-86ec-4a3553a5ba10 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.366300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b817b1-1004-4107-86ec-4a3553a5ba10 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.367975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 78/153] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:17.383916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857a50-d9e8-4882-9ab8-a47cf92c27ce None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.385244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857a50-d9e8-4882-9ab8-a47cf92c27ce None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.385901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d857a50-d9e8-4882-9ab8-a47cf92c27ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.411000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9d857a50-d9e8-4882-9ab8-a47cf92c27ce None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:17.412588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9d857a50-d9e8-4882-9ab8-a47cf92c27ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:17.501298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 76/154] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:17.586729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e55a-b907-436e-8861-7cd2f231e7e5 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.587061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e55a-b907-436e-8861-7cd2f231e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.587419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166e55a-b907-436e-8861-7cd2f231e7e5 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.589148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 79/155] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:17.595106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.595617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.607082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.619958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:17.621106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:17.687383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:17.699232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 77/156] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:17.771363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166e55a-b907-436e-8861-7cd2f231e7e5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:17.804080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:17.865123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:17.928207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166e55a-b907-436e-8861-7cd2f231e7e5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:17.972654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:17.973798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:17.974358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:17.974846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:17.991859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:17.997782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:17.998616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:17.999360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 80/157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:18.006394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.033207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091dda2-a46c-4eab-94a0-9e57aa7605ba None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.119610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.120259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.120536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.124865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.140000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:18.148922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:18.150722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:18.151496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 78/158] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:18.152160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.179846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72bbc-214c-458f-88e1-6bb2e4c8f710 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.182272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:18.243783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.244683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.244979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.245250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.245927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:18.246227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:18.247612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:18.262846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 81/159] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:18.263992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.272553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:18.336698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5312bf-e6cb-4bd0-a198-813bb652dfa3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.399858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.400507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.400912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.401191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.423200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:18.428014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:18.428946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:18.429747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 79/160] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:18.430431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.453267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b78a8-c3af-4dfb-a8cf-224d294aed1a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.531686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.532309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.532586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.532878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.533591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:18.533894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:18.535281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:18.554596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 82/161] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:18.555437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.557917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329bd58-45bf-4126-a194-74821846fc5b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.573004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:18.596144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.596803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.597086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.597429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.598627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:18.600117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:18.602240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 80/162] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:18.603886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.625022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:18.741801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177989e-21ae-45e0-9c8c-d77decd6dd1d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.770472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f335d-8582-41e0-8cd5-726032aacda2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:18.804014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.804647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.805187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.805187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.822756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:18.827896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:18.828818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:18.829732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 81/163] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:18.830375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.837962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:18.838588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:18.838867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:18.839137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:18.839817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:18.840123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:18.841606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:18.859235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 83/164] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:18.860096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:18.908429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.016606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.020186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaaf1c0-4021-4775-874f-c3c287756227 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.037143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0344c9-ef37-4e65-87d4-13af4e0e4cbd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.083164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.083801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.084079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.084348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] PATH_INFO: `/v3/users/82ed3163243941a487c9161b1c295ce7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.085509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] RBAC: Authorizing `identity:get_user(user_id=82ed3163243941a487c9161b1c295ce7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.086979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.089331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 82/165] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/users/82ed3163243941a487c9161b1c295ce7 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:19.090076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:19.090924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.091774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.092290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.092795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.209841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.211336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.257269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461470d8-446a-43f0-89df-bf16ab95b25e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.268783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.340552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.345404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.346197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.346664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.347100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.347974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:19.348145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 84/166] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:19.348669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.349035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:19.354777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ce9f8-4df9-4b58-a393-3b5ff741afcf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.386739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 83/167] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:19.388262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd556-f8c2-4e04-bf83-d734ffcdc51e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.388688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd556-f8c2-4e04-bf83-d734ffcdc51e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.389127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd556-f8c2-4e04-bf83-d734ffcdc51e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.393893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 84/168] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:19.395166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd556-f8c2-4e04-bf83-d734ffcdc51e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:19.498918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0415b09-9955-4166-acd9-56acc6849f5d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.565840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.565840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.565840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.565840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.566223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.567712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.573575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 85/169] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:19 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:19.573575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:19.588253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd556-f8c2-4e04-bf83-d734ffcdc51e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.660512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.661143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.661423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.661683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.680125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.754938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:19.762924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b0f66-d63c-48de-8763-386ff18a6bf5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:19.807642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.809261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a16537-c998-4be3-92c9-09f78a11d26f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.850411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:19.850411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.850411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.850411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:19.851197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:19.851197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:19.851197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 86/170] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:19 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:19.854122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:19.985254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 85/171] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:19.987135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:19.987416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:19.987683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.007592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:20.009664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:20.015377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff57e-95cf-4834-83ab-065f31e28b1c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.042179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.051016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] PATH_INFO: `/v3/users/2f10a52cb2974b4d8984cb32416192fa` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=2f10a52cb2974b4d8984cb32416192fa)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.060140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 87/172] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:19 2022] GET /identity/v3/users/2f10a52cb2974b4d8984cb32416192fa => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:20.060736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.081108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.083788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 86/173] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:20.093187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.166216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccc3a2-4782-4479-b3bc-fdd24aaab0b6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.212868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.212868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.212868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.212868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.281159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.282867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49eb64-51f7-4932-8f4b-ef3e34835dc2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.289748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.292163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d905de8-35b2-4bcd-ac8f-1d66cedb783c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.329596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.330533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.331032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.331588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.332561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:20.333094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.334759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.342196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 87/174] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:20.343352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.428700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 88/175] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:20.430256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fe9d-1f7f-4b14-bda4-6fa83b9f46cb None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.430684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fe9d-1f7f-4b14-bda4-6fa83b9f46cb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.431866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157fe9d-1f7f-4b14-bda4-6fa83b9f46cb None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.433799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 89/176] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:20.434748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157fe9d-1f7f-4b14-bda4-6fa83b9f46cb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.446213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.501149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb932-e609-490b-8529-a4ed250165cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.539717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.540904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.541177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.541475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.542641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.544146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d8288b-7847-460c-97bf-d71daea4e6a0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 88/177] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c9e9-2a67-4194-9cd2-a448c3c72860 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c9e9-2a67-4194-9cd2-a448c3c72860 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404c9e9-2a67-4194-9cd2-a448c3c72860 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 89/178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:20.550516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336fb1-11e9-4314-8b2c-b1e780de79a1 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.551064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336fb1-11e9-4314-8b2c-b1e780de79a1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.551064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed336fb1-11e9-4314-8b2c-b1e780de79a1 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.552326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 90/179] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:20.553047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336fb1-11e9-4314-8b2c-b1e780de79a1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.574451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.582803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157fe9d-1f7f-4b14-bda4-6fa83b9f46cb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.622870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.623647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.623932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.624206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.662518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed336fb1-11e9-4314-8b2c-b1e780de79a1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.691496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.692821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.694402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c5b1a-9ab5-4bfd-9095-48177c493620 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.696060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.696765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.697049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.697320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] PATH_INFO: `/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.698436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] RBAC: Authorizing `identity:get_project(project_id=560a3f3f41c34d4da654401fbd9dfeb2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:20.699905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:20.701573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 91/180] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/projects/560a3f3f41c34d4da654401fbd9dfeb2 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:20.702338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.791871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.799110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 90/181] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:20.800501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1c0b3-26c7-438e-a75c-7f3450a3aaa3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.800820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1c0b3-26c7-438e-a75c-7f3450a3aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.801175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1c0b3-26c7-438e-a75c-7f3450a3aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.806468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f8a3c-4915-4731-8de3-a727ec5e3e88 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.819745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-44a1c0b3-26c7-438e-a75c-7f3450a3aaa3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:20.820951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-44a1c0b3-26c7-438e-a75c-7f3450a3aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:20.840945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:20.841574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.841851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.842120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.852675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:20.858743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:20.859850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 92/182] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:20.865916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:20.892582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 91/183] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:20.893835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c96bd-1979-450a-bdf7-674076a52a15 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.894125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c96bd-1979-450a-bdf7-674076a52a15 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.894397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c96bd-1979-450a-bdf7-674076a52a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:20.911552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-343c96bd-1979-450a-bdf7-674076a52a15 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:20.912841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-343c96bd-1979-450a-bdf7-674076a52a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:20.929868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:20.974287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0fb7-7629-42cb-b819-ae365fc222e0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:20.990268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 92/184] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:20.998028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:20.998311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:20.998582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.015269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.016202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.016385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:21.016892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.017459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.017575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:21.018555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=82ed3163243941a487c9161b1c295ce7) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:21.019060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.021665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.030239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 93/185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:20 2022] GET /identity/v3/role_assignments?user.id=82ed3163243941a487c9161b1c295ce7&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.031426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.132088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.156263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 93/186] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:21.157363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.184068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0c214-3829-4e6f-b3e1-37714b056f2d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.225156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.232482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.233593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.234015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.234294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.235038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=560a3f3f41c34d4da654401fbd9dfeb2, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:21.235349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.236990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.244301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 94/187] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=560a3f3f41c34d4da654401fbd9dfeb2&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.246037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.342635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772a582-4edf-4658-8213-ba276fce2a78 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.367535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febfe3c3-b8b2-4ab4-aece-82cc35f73e86 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.408470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.409177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.409702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.409977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.411789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.413570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.416059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 94/188] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.417075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.417662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.418289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.418573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.418848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.419561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:21.419870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.422148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.433312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 95/189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.433974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.492378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.505466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.552631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9881f9-9111-410d-82a5-f41e7b156d4a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.567123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2fb0b-37c0-43e6-9f8a-64851292fd4a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.590064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.590795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.591080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.591353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.601804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:21.602595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.604032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.604378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.604586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:21.607149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:21.607992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 95/190] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:21.609328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.619350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:21.624553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:21.625458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:21.626245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 96/191] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:21.626906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.711846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61e3f9-d7a2-4a76-ad9e-9bf707d394ff None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.726169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.730000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a1714-2632-4d06-bc54-dca79f206488 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.740180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:21.748146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.748693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.749011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.749287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.750031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=2f10a52cb2974b4d8984cb32416192fa) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:21.750338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.751889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.766617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 96/192] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/role_assignments?user.id=2f10a52cb2974b4d8984cb32416192fa&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.766617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.773438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.774195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.774587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.774974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.793510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.795031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.796807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 97/193] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.797602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.881348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac45128-3431-4097-a63d-8f9bae62020f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.918470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add5d31-282a-49ae-a7ec-5d4fcf6f15b7 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:21.928041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.929084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.929938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.929938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.932559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.933249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.935013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 97/194] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.935694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.963168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:21.964752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:21.964752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:21.964752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:21.965146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:21.965449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:21.966839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:21.975769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 98/195] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:21.976579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:21.998853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.013824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.053943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20ec0-2abb-4ac3-9dc0-1bebe1546bf4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.089153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.089419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86368f-edbe-498b-be9f-dfa74aa25abb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.089752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.090025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.090291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.090945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:22.091241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.092611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.100695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 98/196] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:22.101471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.125079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.125691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.126120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.126395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.197973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.199458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.215636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eeae9-8cdb-48a0-a46b-c0514c2aa0cd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.223424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.232852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.251005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.251553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.251894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.252163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.252833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.254265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.302416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 99/197] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:22.303399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.376744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 99/198] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:22 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:22.376744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.439646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fc42b-c5f0-494f-9572-99d89bdd6058 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.475732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.482835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89d33-7b8b-4ce4-aed4-9d6ff62921aa None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.483022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.483656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.483957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.484207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.485469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.486981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.488685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 100/199] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:22.489607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.521966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.522537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.522818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.523089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] PATH_INFO: `/v3/users/f65647a0349f4625be96d0c320826514` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.524249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=f65647a0349f4625be96d0c320826514)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.526850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.528146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 100/200] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/users/f65647a0349f4625be96d0c320826514 => generated 289 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:22.529009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.577076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.608728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbc672-a639-4ebf-b7b6-b94464fb6e80 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.660050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.660754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.661037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.661309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.663116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.664519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de24bea-dcff-440a-9ed9-675d12d44ae1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.664641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.667720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 101/201] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:22.668533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:22.708898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.709506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.709781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.710049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.750453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.789150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d40c37-c39d-4ab0-b554-1b058f3289e3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:22.805689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.808023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.826864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:22.827627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:22.828033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:22.828397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:22.857327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:22.911224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:22.913105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:22.954852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 101/202] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:22.956557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:23.001189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:23.033342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 102/203] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:23.034561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:23.076274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ae1-a478-403a-acef-f674c8b2f970 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:23.121063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:23.126242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:23.126920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:23.127266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:23.127598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:23.128936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=6aabcda66bc545b497fc21fd9396319a) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:23.129393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:23.131139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:23.139263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 102/204] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:22 2022] GET /identity/v3/role_assignments?user.id=6aabcda66bc545b497fc21fd9396319a&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:23.144891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:23.156435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbaeaa-33e0-416f-bbda-ac52ee2eb595 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:23.195994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:23.197466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:23.197694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:23.197945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:23.205961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:23.207473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:23.209385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 103/205] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:23 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:23.215859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:23.271595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:23.368123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8049c4a-bc56-4048-9fbb-555ada124f85 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:23.385374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151fdf6d-3d71-49cf-8613-6adfcc8500f2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:23.419307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:23.419944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:23.420222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:23.420547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:23.423409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:23.425440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:23.427764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 103/206] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:23 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:23.434592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:23.436676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:23.437319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:23.437593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:23.437862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:23.438598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=6aabcda66bc545b497fc21fd9396319a) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:23.438904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:23.440603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e2c7-8025-4809-befa-455b204a7a25 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:23.460742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 104/207] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:23 2022] GET /identity/v3/role_assignments?user.id=6aabcda66bc545b497fc21fd9396319a&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:23.532464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:23.598528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5213-69be-4df4-bbb4-597e40786d62 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:23.675666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:23.676203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:23.676476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:23.676804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:23.677546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657, user.id=f65647a0349f4625be96d0c320826514) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:23.677852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:23.679350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f61ba0-8490-4132-abf5-c7b1f22c5ce8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:23.686601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 104/208] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:23 2022] GET /identity/v3/role_assignments?user.id=f65647a0349f4625be96d0c320826514&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=696d457f88ff41989009dc2f9fb8998b => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:24.600271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c79e1-1943-4b1d-b87c-601e05275312 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:24.601310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c79e1-1943-4b1d-b87c-601e05275312 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:24.601806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c79e1-1943-4b1d-b87c-601e05275312 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:24.603906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 105/209] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:24.610831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67aee5-a294-4637-afb9-a2d4fc3b4087 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:24.611341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67aee5-a294-4637-afb9-a2d4fc3b4087 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:24.611829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67aee5-a294-4637-afb9-a2d4fc3b4087 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:24.612899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:24.613319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:24.613492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:24.614259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 106/210] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:24.623529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:24.624096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:24.624604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:24.647004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:24.647369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:24.648602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:24.648757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:24.720859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 107/211] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:24.735086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 105/212] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:24.990348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.005263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.020656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.067352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.113048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dddb-b905-4e3d-8734-9b29e1dc3455 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.114509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1722599-b309-45db-a852-6076cd4e0f59 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.151350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.152349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.152843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.153280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.154542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:25.156616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:25.158382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.158650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 106/213] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:25.159400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.159886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.160291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.164172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.178047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:25.185795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:25.186665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:25.187426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:25.192787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 108/214] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:25.193924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.282126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5542bf4-b5d5-4efd-8982-e8e8d53f77c8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.300795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.310282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.315468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e4170-ef34-4d71-be5d-653dd7985f36 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.322376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.323439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.323913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.324375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.325270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:25.326994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34643dc1-abb6-4727-913d-6a2bebb1f608 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:25.351555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.352174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.352454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.352779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.353749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:25.354056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:25.355470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd414add-914b-4c3b-9866-79679d89c334 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:25.364396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 109/215] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:25.365520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f782-1f4e-47a1-88c5-8f96ac2c43f1 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.366006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f782-1f4e-47a1-88c5-8f96ac2c43f1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.366109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580f782-1f4e-47a1-88c5-8f96ac2c43f1 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.367397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 110/216] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:25.373010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580f782-1f4e-47a1-88c5-8f96ac2c43f1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.404419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 107/217] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:25 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:25.414412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.414710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.415056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.445597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:25.447860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:25.502138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580f782-1f4e-47a1-88c5-8f96ac2c43f1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.544264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.544264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.544517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.544750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] PATH_INFO: `/v3/users/5e374e46d6e849c182adc998cc86fb16` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.553112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 108/218] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:25.571086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=5e374e46d6e849c182adc998cc86fb16)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:25.572769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b5f6a-44d1-4d7b-bd25-6a56d912f6f7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:25.577121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 111/219] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/users/5e374e46d6e849c182adc998cc86fb16 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:25.580768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.610824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55d22-6f31-4457-8256-421ccd25da76 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.611344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55d22-6f31-4457-8256-421ccd25da76 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.611344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55d22-6f31-4457-8256-421ccd25da76 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.612687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 112/220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:25.618873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.619357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.619788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.641346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:25.643346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:25.646220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.726217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f79f-6b6c-40da-8e45-1bb1efb500d1 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.746255 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:25.746580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 113/221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:25.771050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:25.771674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:25.771955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:25.772283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:25.845697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.846780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:25.848457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:25.952493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 109/222] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:25.957804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:25.965209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad1d4b-ca7f-4e6d-84a9-9ee5d3004052 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:25.971064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.001868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.002482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.002757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.003328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.015494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:26.020861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:26.021726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:26.022511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 114/223] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:26.023157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.028737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.107549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb1324-8e7e-49a4-a91a-692a51262257 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.146693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10209d26-e86a-4551-b6a1-2b97433c3be5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.149911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.150664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.150924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.151267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.152474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.154021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.155896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 110/224] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:25 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.161390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.195810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.197791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.198077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.198352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.199297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:26.199606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.201996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.214662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 115/225] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.215606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.254826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.279551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9a1c-556c-4ade-beec-f419d4b4ac35 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.303646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.322748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.323384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.323656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.323924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.335753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:26.341429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:26.343525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 111/226] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:26.344892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.362559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c7c64-3198-4634-9738-aac14f073782 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.413280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.413918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.414198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.414615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.415959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=5e374e46d6e849c182adc998cc86fb16) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:26.416538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.418788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.426113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 116/227] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/role_assignments?user.id=5e374e46d6e849c182adc998cc86fb16&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.427249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.516652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d626fe-de9d-4205-911b-e038beba3111 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.568559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e84286-ece9-4b3d-bccf-dec098e6155b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.601556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.611158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.612046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.612459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.612949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.614957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.616681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.619468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 112/228] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.625354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.625984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.626270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.626462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.626563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.627326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:26.627641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.629064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.643134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.650432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 117/229] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.657594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.770440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a36fd-62c6-487d-b6c2-679f381ec413 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.811870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.812654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.812969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.813249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.814790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.816853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.819021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 113/230] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:26.832779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.863997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2cdaf-ce56-4ef3-8e69-1aa361eed14e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:26.921514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:26.922441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:26.922717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:26.922985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:26.924273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:26.925825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:26.935242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 118/231] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:26.940124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:26.945165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:26.986834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cfe321-827a-4246-b512-5b15845d935d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:27.041698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:27.063438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:27.064105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:27.064382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:27.064648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/6aabcda66bc545b497fc21fd9396319a/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:27.067711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, user_id=6aabcda66bc545b497fc21fd9396319a, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:27.070794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40fa35-d1c6-47c4-acee-5a5f7a771306 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:27.108688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b62c61-f0d8-438b-95b4-16ceec356a59 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:27.143820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:27.144372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:27.144775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:27.145051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:27.146176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:27.147659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:27.150406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 119/232] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:26 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:27.159833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 114/233] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:26 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/6aabcda66bc545b497fc21fd9396319a/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:35:27.160331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:27.282541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c6454-6407-412b-92f2-45d5cf1b03ae None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:27.309076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:27.325253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:27.326114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:27.326401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:27.326672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/6aabcda66bc545b497fc21fd9396319a/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:27.333063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, user_id=6aabcda66bc545b497fc21fd9396319a, role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:27.334734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885be11-dd11-4402-9b3b-272f1edb8e21 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:27.445059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 120/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:27 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/6aabcda66bc545b497fc21fd9396319a/roles/f9509a8b59544a6ca684faad78f1d96f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:27.909312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714292-fb48-45dd-acf1-702000cc4ed1 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:27.909312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714292-fb48-45dd-acf1-702000cc4ed1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:27.909312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15714292-fb48-45dd-acf1-702000cc4ed1 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:27.910417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 115/235] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:27.918948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:27.919756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:27.920250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:27.961829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:27.963705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:28.053167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeed14-6df6-4f9a-b3e7-cbb67009e8cc None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.053484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeed14-6df6-4f9a-b3e7-cbb67009e8cc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.053712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eeed14-6df6-4f9a-b3e7-cbb67009e8cc None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.055268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 116/236] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:28.063104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.063104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.063104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.084496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:28.085784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:28.130651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 121/237] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:28.178816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 117/238] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:28.618826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:28.632751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:28.777087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387120-98ee-4907-a6f8-adfd8369ad10 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:28.779083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:28.793984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:28.816526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:28.821266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.821266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.821266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.821266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:28.821266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bba65d9-efc8-4bf4-b5db-c52088a3ba3f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:28.828734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 122/239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:28.828734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8cfd-78ef-42ab-9889-b61b3f728d9b None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.828734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8cfd-78ef-42ab-9889-b61b3f728d9b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.828734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8cfd-78ef-42ab-9889-b61b3f728d9b None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.828734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 123/240] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:28.830702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac8cfd-78ef-42ab-9889-b61b3f728d9b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:28.843374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03006248-7370-43a6-a702-26ab1f74e3b7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:28.880350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:28.880956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.881233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.881502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.892507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-837c7a2a-430f-4a37-9952-7d22549f5014 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:28.897295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:28.898196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:28.898976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 118/241] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:28.900991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:28.900991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:28.901242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:28.925500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:28.926887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:28.967572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac8cfd-78ef-42ab-9889-b61b3f728d9b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.002967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 119/242] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:29.003909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.006428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.007267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.007771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.008414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.009489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:29.011152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:29.069079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.103822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 124/243] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:28 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:29.113274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d4c41-ec08-4e83-b608-0a6e14867138 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.151627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.152239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.152526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.152824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.153558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:29.153860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:29.155294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:29.165935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 120/244] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:29.171983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.210368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.301769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a73e5-08a6-4b99-a131-3157c0e7e728 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.345983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.346627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.346907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.347241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] PATH_INFO: `/v3/users/2811827d13b644d99ba8e7ca1f44e169` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.371675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] RBAC: Authorizing `identity:get_user(user_id=2811827d13b644d99ba8e7ca1f44e169)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:29.373199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:29.375316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 125/245] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/users/2811827d13b644d99ba8e7ca1f44e169 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:29.381200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.402616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.520506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b1e4e-9dbf-4764-92b7-e26b7c59c05f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.533892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.541467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.546020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f55f7-9b78-426c-b9d7-da9169e5326e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.569165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.576428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.576428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.576428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.589114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.589773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.590043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.590389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.605992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0911fca9-8507-47e8-a531-001e2b7a3da5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:29.612630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:29.613809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:29.614672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 126/246] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:29.615385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfd48-8a93-4f16-ab06-708fbe56f7cc None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.615663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfd48-8a93-4f16-ab06-708fbe56f7cc None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.616183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fdfd48-8a93-4f16-ab06-708fbe56f7cc None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.620170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 127/247] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:29.624016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdfd48-8a93-4f16-ab06-708fbe56f7cc None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.723095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:29.724946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96a8b0-e54f-438a-b135-d42e56841aa3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:29.793324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fdfd48-8a93-4f16-ab06-708fbe56f7cc None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:29.832469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:29.833229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.833507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.833775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.834707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:29.834831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:29.836359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:29.839536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 121/248] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:29.841188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:29.841654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:29.842103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:29.855274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 128/249] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:29.856603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:29.863777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:29.865278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:29.885713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.907369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:29.941080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 122/250] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:29.942870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.092138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8adf38-d6af-4fd7-a638-df43de77b77f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.104507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd4595-94ea-4ce3-884b-a92d8021097f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.161178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.162094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.162917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.163702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.164144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.164592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] PATH_INFO: `/v3/users/5e374e46d6e849c182adc998cc86fb16` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.165068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.166186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.167434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] RBAC: Authorizing `identity:get_user(user_id=5e374e46d6e849c182adc998cc86fb16)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.168189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.171244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.171591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9eb4e8-3190-4075-915f-cab9ed3494df None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.173401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 123/251] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/users/5e374e46d6e849c182adc998cc86fb16 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:30.175520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 129/252] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:29 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:30.176022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569738c-d080-48a2-b8f6-fb666517ce4f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.176377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569738c-d080-48a2-b8f6-fb666517ce4f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.176739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569738c-d080-48a2-b8f6-fb666517ce4f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.178084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 124/253] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:30.178994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.185674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.185964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.186228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.221687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:30.223118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:30.245048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:30.286056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f429d8f-fa15-4c63-b4c9-c0b029026bf5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.289033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:30.322119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.323183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.323612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.324012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.325308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.326883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.328962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 130/254] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:30.329871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.355200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 125/255] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:30.356418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.434090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58acb97-c96e-4a29-a162-b6fbf9f1409f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.470582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.471415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.471852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.472252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.473137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=2811827d13b644d99ba8e7ca1f44e169) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:30.473582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.474662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d467-f9b3-43c2-81d5-a2431dd67e37 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.475353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.481954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 131/256] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/role_assignments?user.id=2811827d13b644d99ba8e7ca1f44e169&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=696d457f88ff41989009dc2f9fb8998b => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:30.482898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.502563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:30.513815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.514611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.516623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.516623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.528240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:30.533380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:30.534458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:30.535244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 126/257] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:30.542547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.557112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:30.600853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcc852-a309-4a49-bba7-877cdbe9bc7c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.638555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.639583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.640053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.640512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/5e374e46d6e849c182adc998cc86fb16/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.642734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, user_id=5e374e46d6e849c182adc998cc86fb16, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.644499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.662648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed5854-a223-4a50-a603-9732994b7ed2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.719708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:30.720593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:30.720893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:30.721163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:30.721888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:30.722191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:30.723771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:30.739260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 127/258] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:30.745943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 132/259] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:30 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/5e374e46d6e849c182adc998cc86fb16/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:30.746113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.784967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:30.868028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:30.938758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450583f-ec74-4891-9c46-8bb2593da53b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:30.950290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.002908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f397fe-0949-4219-b9bb-820189a190eb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.021476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.022127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.022409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.022682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.023890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:31.025685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:31.027352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 128/260] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:31.033021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.044240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.045041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.045313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.045593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.059943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:31.065833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:31.066787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:31.067571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 133/261] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:31.073888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.185388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e49e-fb84-4e60-9de0-fefee49a6589 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.222078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.222669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.222951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.223221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.223891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:31.224198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:31.225897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:31.229047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.235431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 134/262] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:31.240926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.310883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ff0b-f428-400e-ab5f-ef54b8fac2bb None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.347373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c65a80a-a376-43a3-9b89-a23a22a3d2cb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.390759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.391398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.391681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.391952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] PATH_INFO: `/v3/users/6aabcda66bc545b497fc21fd9396319a` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.393196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] RBAC: Authorizing `identity:get_user(user_id=6aabcda66bc545b497fc21fd9396319a)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:31.394916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:31.396662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 135/263] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/users/6aabcda66bc545b497fc21fd9396319a => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:31.402667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.414015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.414647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.415083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.415869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.423350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.481113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.513979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66678-06b7-4351-a746-2d05f4013606 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.559984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:31.566034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:31.566034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:31.566034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:31.603650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:31.605182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:31.638365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:31.640292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:31.749264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.757989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 136/264] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:31.765420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.780746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 129/265] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:31.789761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:31.855256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:31.918949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8fe38-4759-4dde-b189-b62699f458cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:31.953077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089f4aa-f717-4abb-be10-b31fb50678ba None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:32.004978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:32.007383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.008818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.010400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.013017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:32.015744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f023d-119b-4edb-af29-4c0e7ba29ade None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:32.018921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 137/266] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:32.027253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c824-82b7-4773-bcf8-d06e38b01dd7 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.028831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:32.030038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.030505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c824-82b7-4773-bcf8-d06e38b01dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.030963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c824-82b7-4773-bcf8-d06e38b01dd7 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.032472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 138/267] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:32.032969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.033436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.034954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:32.037999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.038476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.038931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.041671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:32.043690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 130/268] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:31 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:32.045800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:32.071696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:32.073280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:32.104630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:32.157725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 139/269] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:32.159023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:32.328625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5764e-cb48-4972-b0d2-482a6c3a81a7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:32.330619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:32.379763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85851a1-023a-449d-8061-37692cd2c07f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:32.398707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:32.400370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.402115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.403273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.404210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=6aabcda66bc545b497fc21fd9396319a) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:32.404934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:32.407906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e6af4-0f8c-4098-a2d2-4a1c0bd30899 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:32.420416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 131/270] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:32 2022] GET /identity/v3/role_assignments?user.id=6aabcda66bc545b497fc21fd9396319a&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 608 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:32.421906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d502d-6947-42cd-841d-02057dd8aaae None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.423310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d502d-6947-42cd-841d-02057dd8aaae None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.429458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d502d-6947-42cd-841d-02057dd8aaae None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.433527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 132/271] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:32.439774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.440365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.440887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.463332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:32.463954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.464234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.464507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.465288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=6aabcda66bc545b497fc21fd9396319a) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:32.465596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:32.467056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:32.483964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:32.485248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:32.485855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 140/272] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:32 2022] GET /identity/v3/role_assignments?user.id=6aabcda66bc545b497fc21fd9396319a&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:32.568645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 133/273] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:32.613321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:32.664197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:32.756644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e772247-d5e2-4a3d-80e0-08da7aaad0a6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:32.804858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:32.806461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:32.806942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:32.807397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:32.818551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:32.824597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:32.825598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:32.826380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:32.828952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 141/274] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:32.838051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:32.941626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:32.947920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489cf1e-b394-469d-8ef2-40a2e00ef87d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:32.966896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:33.005236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.005919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.006195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.006471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.007141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:33.007441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:33.009392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:33.019736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 134/275] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:33.026179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:33.097203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:33.112306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a963014-9b20-4f8e-845b-b098f325bdbc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:33.136323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f33f3c-b382-4d0e-bfa7-c4408259a1f0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:33.157710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.158404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.158758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.159036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.160334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:33.161966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:33.164057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 142/276] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:33.170547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:33.180902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.181604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.181889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.182168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] PATH_INFO: `/v3/users/e24678b80bba49e8b90373b392aa1565` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.202077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=e24678b80bba49e8b90373b392aa1565)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:33.204341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a9c18-65d3-47da-9868-054eec5af6d6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:33.206925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 135/277] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:33 2022] GET /identity/v3/users/e24678b80bba49e8b90373b392aa1565 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:33.210896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201d16-6da2-4361-a372-9c9b224a6dbe None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.211240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201d16-6da2-4361-a372-9c9b224a6dbe None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.211521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61201d16-6da2-4361-a372-9c9b224a6dbe None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.213800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 136/278] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:33.215470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201d16-6da2-4361-a372-9c9b224a6dbe None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:33.237531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:33.293286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedb2c7-0300-4dd7-a432-88620d8a8ec2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:33.326870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61201d16-6da2-4361-a372-9c9b224a6dbe None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:33.328345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.328997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.329283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.329551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.330202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:33.331642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254bd85-a244-4546-ba14-eb2b5e6ad9f5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:33.364023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.364620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.364923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.365194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.365921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, user.id=e24678b80bba49e8b90373b392aa1565, scope.system=all) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:33.366229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:33.367664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faa7fc-c854-47d7-b22f-7b9e14208dae None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:33.373227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 137/279] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 14:35:33 2022] GET /identity/v3/role_assignments?user.id=e24678b80bba49e8b90373b392aa1565&scope.system=all&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:33.374545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548a30-2f90-439e-88f3-489bdba3cedd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.374782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548a30-2f90-439e-88f3-489bdba3cedd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.375050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c548a30-2f90-439e-88f3-489bdba3cedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.403828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8c548a30-2f90-439e-88f3-489bdba3cedd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:33.405111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8c548a30-2f90-439e-88f3-489bdba3cedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:33.444758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 143/280] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:33 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:33.512193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 138/281] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:33.604539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ff07-fce9-4b45-a4e3-27b1421bb826 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.604942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ff07-fce9-4b45-a4e3-27b1421bb826 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.605122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ff07-fce9-4b45-a4e3-27b1421bb826 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.606669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 144/282] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:33.622008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.622286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.622562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.642283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:33.643486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:33.647412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:33.717478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 139/283] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:33.803762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99ff07-fce9-4b45-a4e3-27b1421bb826 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:33.820335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:33.921732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99ff07-fce9-4b45-a4e3-27b1421bb826 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:33.957407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:33.958286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:33.958561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:33.958822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:33.971940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:33.976751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:33.978151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:33.979096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 145/284] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:33.984614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.041693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.148652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e94ec-1bcb-4504-9f53-fb0b8c6ee1fa None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.186753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.187757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.188095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.188429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.189191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:34.189554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:34.191474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:34.201251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 140/285] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:34.208478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.213336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.220215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.238535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000934b-79c2-4c9b-9af1-c932ce9a0422 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.293504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.294630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.295225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.295500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.320746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:34.324121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:34.325034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:34.325848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 146/286] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:34.335801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.401122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87ba0e-c75a-4773-b9d5-164f5528c1b8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.471059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab27399-4285-4f29-9425-a01c1dd5b288 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.506329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.510395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.511088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.511433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.511772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.512521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:34.513052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:34.514520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:34.523940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 147/287] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:34.529528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.530198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.530469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.530696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.530804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] PATH_INFO: `/v3/users/2811827d13b644d99ba8e7ca1f44e169` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.537567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] RBAC: Authorizing `identity:get_user(user_id=2811827d13b644d99ba8e7ca1f44e169)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:34.539049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:34.541597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 141/288] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/users/2811827d13b644d99ba8e7ca1f44e169 => generated 297 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:34.547234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.644005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097eee3-4f90-4204-9906-74019097bb16 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.682307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.682908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.683185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.683507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] PATH_INFO: `/v3/users/5e374e46d6e849c182adc998cc86fb16` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.684668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] RBAC: Authorizing `identity:get_user(user_id=5e374e46d6e849c182adc998cc86fb16)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:34.686598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:34.692945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 148/289] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/users/5e374e46d6e849c182adc998cc86fb16 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:34.694193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:34.785162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.805064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7931bb-9191-4f92-ad2e-850419a92d22 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:34.833877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:34.847346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:34.848036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:34.848321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:34.848595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:34.924997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:34.926717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:34.934708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d045f5-fa1a-4ab7-a127-689c2616fdbd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:35.020844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:35.042075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:35.042711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.043037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.043313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.044454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:35.045930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:35.047955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 142/290] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:35.053714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:35.092857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 149/291] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:35.094641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:35.248837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac82e47-2269-46f2-a137-8ccca6005866 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:35.266622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c3743-c540-404c-926d-9485aa887ab2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:35.307423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:35.308994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.309271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.309544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.313368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:35.314836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:35.316690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 150/292] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:35 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:35.323924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:35.348654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:35.349351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.349671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.350165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/2811827d13b644d99ba8e7ca1f44e169/roles/696d457f88ff41989009dc2f9fb8998b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.358957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, user_id=2811827d13b644d99ba8e7ca1f44e169, role_id=696d457f88ff41989009dc2f9fb8998b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:35.358957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754aeba-4721-4b31-bb17-e143afef5038 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:35.378937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:35.429561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:35.436084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 143/293] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:35:35 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/users/2811827d13b644d99ba8e7ca1f44e169/roles/696d457f88ff41989009dc2f9fb8998b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:35.437491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c958-8d80-4f7d-8f45-b243c0e54f6f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.437916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c958-8d80-4f7d-8f45-b243c0e54f6f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.438344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932c958-8d80-4f7d-8f45-b243c0e54f6f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.444373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 144/294] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:35.446720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be3c0-80d9-4b1d-a286-ff84af95aa14 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.447211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be3c0-80d9-4b1d-a286-ff84af95aa14 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.447546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7be3c0-80d9-4b1d-a286-ff84af95aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.457143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445df5d6-a828-473f-98a7-f445179a9e79 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:35.468934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9d7be3c0-80d9-4b1d-a286-ff84af95aa14 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:35.470687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9d7be3c0-80d9-4b1d-a286-ff84af95aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:35.499031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:35.499559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.499831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.500141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.500994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=5e374e46d6e849c182adc998cc86fb16) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:35.501305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:35.502835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:35.512688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 151/295] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:35 2022] GET /identity/v3/role_assignments?user.id=5e374e46d6e849c182adc998cc86fb16&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:35.567915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 145/296] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:35.850333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:35.954357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:35.956538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fbe9f-c6da-47b4-9524-dbc86d893bbd None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.956863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fbe9f-c6da-47b4-9524-dbc86d893bbd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.957143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fbe9f-c6da-47b4-9524-dbc86d893bbd None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.958638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 146/297] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:35.964447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e3fb-24c9-4ed6-9512-36d69eaa39a4 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:35.970445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e3fb-24c9-4ed6-9512-36d69eaa39a4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:35.970445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496e3fb-24c9-4ed6-9512-36d69eaa39a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:35.970740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44da2b-aa75-4f0e-81cb-ce33bac46287 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:35.985607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0496e3fb-24c9-4ed6-9512-36d69eaa39a4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:35.986935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0496e3fb-24c9-4ed6-9512-36d69eaa39a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:36.014703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.015708 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.016204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.016669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.041307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:36.047557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:36.048432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:36.049590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:36.054009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 152/298] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:36.061667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.086582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 147/299] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:36.113556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24572a-6275-4113-8072-31955503afb1 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.113843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24572a-6275-4113-8072-31955503afb1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.114100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24572a-6275-4113-8072-31955503afb1 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.115754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 148/300] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:35:36.122797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.123229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.123650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.154967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:36.156181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:36.201769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1136-6776-4c90-a80b-2669d369a8e6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.225152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.244495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.245152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.245458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.245735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.246407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:36.246703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.248089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.248861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 149/301] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:36.258264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 153/302] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:36.264602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.369293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.387732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64887089-80e3-4564-9fee-2c4331fa59d0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.400322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.427678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.428959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.429680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.430128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] PATH_INFO: `/v3/users/e24678b80bba49e8b90373b392aa1565` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.432232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e24678b80bba49e8b90373b392aa1565)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.434523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.437053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 150/303] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/users/e24678b80bba49e8b90373b392aa1565 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:36.442282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.495272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55931c4f-4895-41c0-afdb-4713fd967954 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.525002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.538536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.539314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.540057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.540057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.551162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:36.556988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:36.557844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:36.558623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 154/304] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:36.559350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.580966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b7dee9-91bc-4d01-a7ca-3d8708c855a3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.618777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.620008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.620460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.620756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] PATH_INFO: `/v3/system/users/e24678b80bba49e8b90373b392aa1565/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.622373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e24678b80bba49e8b90373b392aa1565, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.623741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.651494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.674597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf590f86-50eb-4908-aed1-0707b4b4d012 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.707884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.708505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.708812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.709080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.710178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.711759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.713521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 155/305] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:36.714105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.720665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 151/306] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 24 14:35:36 2022] PUT /identity/v3/system/users/e24678b80bba49e8b90373b392aa1565/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:35:36.728932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.851806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3191912-c5f3-4b6f-8289-359b262c61d9 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.864734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f0807-ce91-46e2-a3f5-d916a689bb8d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:36.880016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.893304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.894363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.894363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.894695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] PATH_INFO: `/v3/groups` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.895334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.896877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.906028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:36.906627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:36.906896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:36.907161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:36.907824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:36.908120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:36.909539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:36.918790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 156/307] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:36.924010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:36.933669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:36.986027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 152/308] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 24 14:35:36 2022] POST /identity/v3/groups => generated 229 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:35:37.037499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85f048-1350-4257-85c2-4c2d11bb0fbe None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:37.081133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:37.082175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:37.082655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:37.083125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] PATH_INFO: `/v3/users/ecc14d3224d946f08031ac83d0e437e3` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:37.100924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc14d3224d946f08031ac83d0e437e3)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:37.104347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770058a-9cde-43f6-b421-ff641ed8c478 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:37.106508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 157/309] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:36 2022] GET /identity/v3/users/ecc14d3224d946f08031ac83d0e437e3 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:37.117956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:37.235200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1075a-c990-435c-8a1b-a45ec166c1ac None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:37.270085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:37.271035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:37.271505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:37.271970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:37.272944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, user.id=ecc14d3224d946f08031ac83d0e437e3, scope.system=all) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:37.273449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:37.275621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6d50d-e845-4839-83a2-22fdfa6faa0c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:37.281602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 153/310] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 14:35:37 2022] GET /identity/v3/role_assignments?user.id=ecc14d3224d946f08031ac83d0e437e3&scope.system=all&role.id=696d457f88ff41989009dc2f9fb8998b => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:37.596991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c1af-83e9-488f-9e45-8c787894e2b2 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:37.597559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c1af-83e9-488f-9e45-8c787894e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:37.597559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672c1af-83e9-488f-9e45-8c787894e2b2 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:37.598993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 158/311] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:37.604603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:37.605133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:37.605300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:37.624370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:37.626063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:37.670855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:37.698915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 154/312] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:37.965710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c1af-83e9-488f-9e45-8c787894e2b2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:38.035945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:38.081714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672c1af-83e9-488f-9e45-8c787894e2b2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:38.120200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:38.120872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.121153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.121426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.132125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:38.137444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:38.139446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:38.140599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 159/313] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:38.145841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:38.265694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d55c051-3dae-453c-a503-219eac0de8e7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:38.303266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:38.303845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.304118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.304384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.305084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:38.305767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:38.307593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:38.317075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 155/314] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:38.325860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:38.442317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b851036-59e9-4138-9a13-88cf25b81fa9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:38.467603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:38.479820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:38.480454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.480766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.481048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] PATH_INFO: `/v3/users/2811827d13b644d99ba8e7ca1f44e169` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.482184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] RBAC: Authorizing `identity:get_user(user_id=2811827d13b644d99ba8e7ca1f44e169)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:38.483755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb601d-09e3-48b2-93c7-be23c0b86a1b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:38.485569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 160/315] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:38 2022] GET /identity/v3/users/2811827d13b644d99ba8e7ca1f44e169 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:38.491225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:38.530344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:38.603962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16cb29-2e70-4f6b-8390-d67fd172494f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:38.639901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:38.640513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.640809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.641152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.720836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:38.722312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:38.759599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:38.817863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209a65-15d0-4225-973b-73c14d26dae9 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.818473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209a65-15d0-4225-973b-73c14d26dae9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.818473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209a65-15d0-4225-973b-73c14d26dae9 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.819944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 161/316] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:35:38.825606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.825958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.826230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.830781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 156/317] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:38.837305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:38.850343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:38.851588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:38.933041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 162/318] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:38.950927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094c900-32ab-40d8-bc98-95e9a1bb87e8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:38.987398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:38.988039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:38.988321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:38.988595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:38.989763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:38.991205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd26ce-c361-4d55-ac8e-9a078feede73 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:38.992883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 157/319] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:38 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:38.999492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.098324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843aa3-0893-4502-9818-48d0473ddb5c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.098644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843aa3-0893-4502-9818-48d0473ddb5c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.098862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3843aa3-0893-4502-9818-48d0473ddb5c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.100494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 158/320] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:35:39.106891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c423a-3712-45e4-ab77-d58c312ecffc None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.107178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c423a-3712-45e4-ab77-d58c312ecffc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.107459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c423a-3712-45e4-ab77-d58c312ecffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.114921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.115992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f2ef-f024-4759-9477-720b1fb5ae91 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.127402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-972c423a-3712-45e4-ab77-d58c312ecffc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:39.134661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-972c423a-3712-45e4-ab77-d58c312ecffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:39.141532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.154018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.154625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.154895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.155159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.155884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412, user.id=2811827d13b644d99ba8e7ca1f44e169) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:39.156189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:39.157800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:39.166182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 163/321] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:35:38 2022] GET /identity/v3/role_assignments?user.id=2811827d13b644d99ba8e7ca1f44e169&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=696d457f88ff41989009dc2f9fb8998b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:39.215144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 159/322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:39.218758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.279885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a996c-685b-4db5-8920-e92ec17d7e41 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.280166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a996c-685b-4db5-8920-e92ec17d7e41 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.280430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a996c-685b-4db5-8920-e92ec17d7e41 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.282100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 160/323] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:39.287909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.288198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.288477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.313071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:39.314849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:39.343150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c220e-0235-4f52-b752-77762aa9de61 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.392568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.394078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.394360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.394632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.407700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 161/324] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:39.413091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:39.419161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:39.420055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:39.420874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:39.421480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 164/325] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:39.427552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.496242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.510280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.537353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeb828-73a9-4a76-a4b6-48dfed136307 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.559503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.575784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.576385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.576657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.576958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.577618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:39.577916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:39.579443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:39.591086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 162/326] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:39.596812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.622987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac6602-8d77-4fac-af00-e8291d3be7d2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.659897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.660759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.661035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.661307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.662499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:39.664011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:39.671884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 165/327] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:39.673024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.703571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182052b5-af59-49a3-8721-1c1adaf0eb1a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.729701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.737656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.738310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.738587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.738860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] PATH_INFO: `/v3/users/e24678b80bba49e8b90373b392aa1565` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.739978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] RBAC: Authorizing `identity:get_user(user_id=e24678b80bba49e8b90373b392aa1565)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:39.743717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:39.743717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 163/328] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/users/e24678b80bba49e8b90373b392aa1565 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:39.743958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.779216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2fbff-f6ca-4f66-881f-5fad0ac31cbc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.793038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:39.813358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.813973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.814233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.814501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] PATH_INFO: `/v3/groups` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.815111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:39.816550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:39.844018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1136e2-3db3-46eb-b9a6-6a8bd5dbdb4c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:39.876111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:39.876752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:39.877035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:39.877325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:39.887897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:39.893067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:39.894111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:39.895076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 164/329] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:39.896600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.907824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 166/330] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 24 14:35:39 2022] POST /identity/v3/groups => generated 226 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:35:39.908753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:39.960407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:40.012145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df720eb-abde-401e-b144-da5babe59c28 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:40.031052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23465177-2a5f-468f-9ed9-6d37686ac33f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:40.052033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:40.053043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:40.053043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:40.053493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:40.054320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] RBAC: Adding query filter params (role.id=268d6b86cbf444be9d29d3be41ba5e3f, user.id=e24678b80bba49e8b90373b392aa1565, scope.system=all) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:40.055997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:40.058291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:40.069751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 165/331] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/role_assignments?user.id=e24678b80bba49e8b90373b392aa1565&scope.system=all&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:40.072704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:40.073355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:40.073629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:40.073899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:40.074571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:40.074874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:40.076284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:40.087114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 167/332] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:40.093204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:40.217244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdfd8a-aab3-4d0c-b882-38d0736377ee None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:40.232197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:40.254801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] PATH_INFO: `/v3/users/ecc14d3224d946f08031ac83d0e437e3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc14d3224d946f08031ac83d0e437e3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03c12e-e13a-48df-9675-499684fe38d2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:40.264138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 166/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:40 2022] GET /identity/v3/users/ecc14d3224d946f08031ac83d0e437e3 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:40.267209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:40.306115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:40.384180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd39f7e-4f05-44c6-b591-7bc377e22caa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:40.419449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:40.420469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:40.420979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:40.421446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] PATH_INFO: `/v3/system/users/ecc14d3224d946f08031ac83d0e437e3/roles/696d457f88ff41989009dc2f9fb8998b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:40.423038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ecc14d3224d946f08031ac83d0e437e3, role_id=696d457f88ff41989009dc2f9fb8998b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:40.424758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb977c-e318-4f7f-8e53-dcc023b71192 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:40.490984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 168/334] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 24 14:35:40 2022] PUT /identity/v3/system/users/ecc14d3224d946f08031ac83d0e437e3/roles/696d457f88ff41989009dc2f9fb8998b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:42.114392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4598-0a01-4b3f-b517-275ac709306b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.115512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4598-0a01-4b3f-b517-275ac709306b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.116033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a4598-0a01-4b3f-b517-275ac709306b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.117627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 167/335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:42.123184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde55d89-a547-4b8f-9fd6-fb48089b3ed6 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.123993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde55d89-a547-4b8f-9fd6-fb48089b3ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.124464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde55d89-a547-4b8f-9fd6-fb48089b3ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.152433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-dde55d89-a547-4b8f-9fd6-fb48089b3ed6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:42.153993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dde55d89-a547-4b8f-9fd6-fb48089b3ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:42.243021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 169/336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:42.563813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4598-0a01-4b3f-b517-275ac709306b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:42.649850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57434e-76eb-497c-80dd-10069eaf6dc6 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.650457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57434e-76eb-497c-80dd-10069eaf6dc6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.650930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57434e-76eb-497c-80dd-10069eaf6dc6 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.652476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 170/337] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:42.657682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab558-cd08-4342-8164-2b4a3508ce96 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.657959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab558-cd08-4342-8164-2b4a3508ce96 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.658231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390ab558-cd08-4342-8164-2b4a3508ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.703196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-390ab558-cd08-4342-8164-2b4a3508ce96 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:42.704498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-390ab558-cd08-4342-8164-2b4a3508ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:42.744663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:42.822581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a4598-0a01-4b3f-b517-275ac709306b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:42.827385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 171/338] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:42.828768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0941fc-94b4-4a7a-871a-974facbc5b54 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.829102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0941fc-94b4-4a7a-871a-974facbc5b54 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.829372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0941fc-94b4-4a7a-871a-974facbc5b54 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.830797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 172/339] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:42.847834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6ae9-dfc5-4959-a4a6-604050b0a51f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.848104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6ae9-dfc5-4959-a4a6-604050b0a51f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.848377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6ae9-dfc5-4959-a4a6-604050b0a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.880926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f61a6ae9-dfc5-4959-a4a6-604050b0a51f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:42.882125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f61a6ae9-dfc5-4959-a4a6-604050b0a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:42.894569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:42.895218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:42.895494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:42.895757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:42.921732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:42.926996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:42.927859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:42.928649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:42.932819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 168/340] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:42.934894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.022774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.026867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 173/341] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:43.114576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e064c-cf20-4dce-98b4-0d598b41d486 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:43.124127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8248-7c84-4eac-ac09-7393d80a6b5c None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.124590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8248-7c84-4eac-ac09-7393d80a6b5c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.124662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea8248-7c84-4eac-ac09-7393d80a6b5c None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.126253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 174/342] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:43.132367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.132651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.132951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.167133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:43.167748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.168030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.168300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.168479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:43.168997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:43.169303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:43.169698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:43.170699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:43.188426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 169/343] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:43.193758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.302287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 175/344] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:43.303933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.347227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.361341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d37ec0-6470-48b1-837d-55440515bf0b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:43.362954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.430041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:43.430683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.430955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.431221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.469864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd97e5-23c7-4214-b03e-b3e623a7be92 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:43.558455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:43.559423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.559873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.560311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.579940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:43.580738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:43.582418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:43.588000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:43.588913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:43.589722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:43.593730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 176/345] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:43.595726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.707601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 170/346] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:43.708616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.710914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.815344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a87ed-c2f1-455a-ab34-6fe6a2ea51fe None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:43.819858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7772f4-805f-4878-8920-ba7e21519ee8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:43.833119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:43.860428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:43.861805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.861805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.861805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.862584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:43.862888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:43.864430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:43.866102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:43.867410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:43.872739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:43.872739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:43.875151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 171/347] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:43.876413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.885141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:43.891165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:43.892350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:43.893368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:43.894504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 177/348] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:43.895776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:43.967259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.010175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8497853-df8e-47c6-b7e3-600c43202e07 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.013826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690ece6-b633-40f7-b78f-6a5c5c9c251b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.048819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.049694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.050126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.050513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.056876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.057621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.057975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.058323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.059716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.060790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.062244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.064087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 172/349] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:44.064490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:44.065271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:44.080862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:44.081793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 178/350] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:44.082590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.188907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5fba2-1d78-4a0f-a0d2-df025ea384f0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.198849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7796fae-0ce2-4495-a51f-3145c2840158 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.237099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.240959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.241578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.241870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.242126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.243433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:44.243738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.244524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.245167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.245267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.245446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.245721 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.255885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 179/351] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:44.257328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.328515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.330124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525edf3-b5f4-4611-bc67-4d429d56ed23 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.336358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.401102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d75c6-d3a5-49c5-bf04-60ac82cbada0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.442219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.444170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.444630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.445115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.452798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.454654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.456482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 180/352] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:44.457440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.463011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 173/353] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:44.463011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98bee-29e6-41d1-9251-d4c44b73decc None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.463011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98bee-29e6-41d1-9251-d4c44b73decc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.463011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d98bee-29e6-41d1-9251-d4c44b73decc None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.463011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 174/354] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:44.463589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98bee-29e6-41d1-9251-d4c44b73decc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.501916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.584034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d05a9a-11dc-43cd-9780-4db8a6ab12cb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.589066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d98bee-29e6-41d1-9251-d4c44b73decc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.615221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.624784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.625396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.630174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.630174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.630174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:44.630174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.630174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.635890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.636504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.636813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.637443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.637546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 181/355] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:44.638033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.722807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.724277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.762202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.766426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d40dc-a1e8-439f-928f-1df204328678 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:44.807874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:44.808479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.808783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.809624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.809811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:44.810074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:44.811512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bae7c2-895b-4732-aab6-f9b93a527138 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:44.819701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 182/356] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:44.821127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c94e2-26a4-4aa2-a086-435108d03e7f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.821237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c94e2-26a4-4aa2-a086-435108d03e7f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.821436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c94e2-26a4-4aa2-a086-435108d03e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.847726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9e2c94e2-26a4-4aa2-a086-435108d03e7f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:44.849904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9e2c94e2-26a4-4aa2-a086-435108d03e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:44.856890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 175/357] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:44.858853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:44.919739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:44.945281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 183/358] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:44.947533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf2a0-49d8-4096-810c-895eb0387c8d None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:44.947885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf2a0-49d8-4096-810c-895eb0387c8d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:44.948223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf2a0-49d8-4096-810c-895eb0387c8d None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:44.949638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 184/359] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:44.950415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf2a0-49d8-4096-810c-895eb0387c8d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.005121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205b548-cd26-4ec7-88d1-53219ea97b4f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.047842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.055370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.056469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 176/360] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.065631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.078511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf2a0-49d8-4096-810c-895eb0387c8d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.123539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.124385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.124899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.125327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] PATH_INFO: `/v3/users/ecc14d3224d946f08031ac83d0e437e3` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.126909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] RBAC: Authorizing `identity:get_user(user_id=ecc14d3224d946f08031ac83d0e437e3)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.129328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920d6e8-8f68-4919-bd79-8af6d37a5076 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.132232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 185/361] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:35:44 2022] GET /identity/v3/users/ecc14d3224d946f08031ac83d0e437e3 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.133787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.134221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.134617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.163256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:45.165218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:45.201676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46bea6-69e5-4075-9196-b464bfc758a0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.221286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.244097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.244800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.245143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.245499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.247025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 186/362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:45.247937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.254295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.255764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.257534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 177/363] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.258324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.347842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.388349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8143713-1a7a-4501-9a82-8f9addccc1da None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.389906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4a4d7-2ce3-412d-a236-c24828e6a80c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.434462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.434843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.435175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.435455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.435852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.436245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.436625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] RBAC: Adding query filter params (role.id=696d457f88ff41989009dc2f9fb8998b, user.id=ecc14d3224d946f08031ac83d0e437e3, scope.system=all) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:45.436948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.437045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.437472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.438421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.439213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.441846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.444258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 187/364] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.445679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.457104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 178/365] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/role_assignments?user.id=ecc14d3224d946f08031ac83d0e437e3&scope.system=all&role.id=696d457f88ff41989009dc2f9fb8998b => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.457947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.540235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.627051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85316517-576b-4883-a081-1b2fd39f0813 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.644563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4abb42-7bcc-4fd5-996b-2bcfea438f22 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.676033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.683022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.683666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.683945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.684216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.687971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.691532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.691532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.691532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.691532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.692578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.694339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 179/366] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.695372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:45.696616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:45.701804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:45.702885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:45.703880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:45.706260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 188/367] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:45.707080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.833005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb04414-b427-4c70-805e-ec34d4afdcfe None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.840121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16d340-86d1-436c-8b95-137ff3d47215 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:45.848635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:45.875139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.875139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.875139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.875139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.875969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:45.875969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:45.877498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:45.884981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 180/368] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:45.885813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.887679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:45.888536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:45.888868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:45.889148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:45.905357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:45.910545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:45.911688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:45.912665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:45.914339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 189/369] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:45.920558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:45.972173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:46.038220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce789cf-44ef-4d46-b0f5-525dd494d922 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:46.073536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcd5c4c-12b1-47f8-ba2d-1ecb786b8ac9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:46.077636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:46.077636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:46.078040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:46.078411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:46.079277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:46.079693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:46.081358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:46.088279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 181/370] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:46.088901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:46.150362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:46.153010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:46.153439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:46.154893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:46.156048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:46.157925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:46.162063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:46.187907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 190/371] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:46.194866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:46.263317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:46.344170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c8177-0179-44d8-92d0-daf837ddbf10 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:46.390404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:46.415432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:46.416356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:46.417022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:46.417462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:46.418629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:46.419162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:46.422460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:46.429722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51455a-78c9-4106-9820-d30966227402 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:46.440408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 182/372] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:46.442874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:46.492548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:46.494507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:46.495086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:46.495752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:46.591647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c1a56-2637-439b-8c39-546bab10ed68 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:46.654307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:46.654933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:46.655207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:46.655479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:46.717964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:46.719372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:46.792507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:46.798807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:46.819807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:46.821869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:46.902067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 191/373] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 709 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:46.909413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:46.977956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 183/374] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:46.984269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:47.054072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b0a18-d896-417d-8ef3-23a7eff3986e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.094288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:47.105710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:47.112081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.112814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.113105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.113378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.114575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.117404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.119974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 192/375] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:46 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:47.126227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:47.134904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbebca-35f8-4e49-bb94-41e4ec75912c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.192295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.193324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.193811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.194270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] PATH_INFO: `/v3/projects/08e00cc0e88b4e1a866763955e5979af` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.201513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] RBAC: Authorizing `identity:get_project(project_id=08e00cc0e88b4e1a866763955e5979af)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.203288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.205563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 184/376] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:46 2022] GET /identity/v3/projects/08e00cc0e88b4e1a866763955e5979af => generated 344 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:47.211739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:47.283354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc19e36-1dca-46e7-8fd4-e8cc24e55cc6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.376144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc5be2e-281d-404e-9f96-1ddc91a30e4d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.381032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.381692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.381969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.382233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.389484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.390987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.392673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 193/377] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:47 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:47.398664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:47.418262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.418933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.419208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.420024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] PATH_INFO: `/v3/groups/3a55adfa621d4cecaf535910b93a5d1d` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.429700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] RBAC: Authorizing `identity:get_group(group_id=3a55adfa621d4cecaf535910b93a5d1d)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.431496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.433467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 185/378] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:47 2022] GET /identity/v3/groups/3a55adfa621d4cecaf535910b93a5d1d => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:47.439460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:47.469601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:47.558088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:47.574403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343049e-62b8-4713-ad58-346a918ef587 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.593192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ec90c-1b48-4992-82bc-07fc46865b8b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:47.622472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.623676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.624316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.625133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.626373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] RBAC: Adding query filter params (group.id=3a55adfa621d4cecaf535910b93a5d1d, role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=08e00cc0e88b4e1a866763955e5979af) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:47.627027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.629536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12418-fe46-45d9-8d5f-31e52459f296 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.635747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:47.636364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.636641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.636975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.637449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 186/379] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:47 2022] GET /identity/v3/role_assignments?group.id=3a55adfa621d4cecaf535910b93a5d1d&scope.project.id=08e00cc0e88b4e1a866763955e5979af&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:47.637713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:47.638025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:47.639341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827d74-acbd-4bec-b26b-316437b66b26 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.639557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:47.639903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827d74-acbd-4bec-b26b-316437b66b26 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.640307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8827d74-acbd-4bec-b26b-316437b66b26 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.642222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 187/380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:47.648591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cade1-67d6-4ec5-ae00-3096b0cc46eb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:47.649663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cade1-67d6-4ec5-ae00-3096b0cc46eb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:47.650078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cade1-67d6-4ec5-ae00-3096b0cc46eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:47.650458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 194/381] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:47 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:47.690031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-730cade1-67d6-4ec5-ae00-3096b0cc46eb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:47.691352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-730cade1-67d6-4ec5-ae00-3096b0cc46eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:47.790160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 188/382] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:48.172292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:48.277272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee5d3-3217-40ed-a2cf-ec0061581c52 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.277942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee5d3-3217-40ed-a2cf-ec0061581c52 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.278450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ee5d3-3217-40ed-a2cf-ec0061581c52 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.280466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 189/383] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:48.288935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.289601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.290076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.300852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b535f-e94e-4685-a2b0-4fd2eeadc542 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:48.331600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:48.334055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:48.343652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:48.348646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:48.354024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:48.356594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.356594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.356594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.381625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:48.388742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:48.389926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:48.390719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:48.393599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 195/384] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:48.403385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:48.486756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 190/385] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:48.548958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2b8e8-f911-4464-b176-953ca04e5a3a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:48.596503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:48.597166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.597442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.597713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.598389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:48.598690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:48.600080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfcf1f-a41d-48fd-ac9b-8725a794d7ff None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:48.609553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 196/386] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:48.614890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:48.711820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba9a2-d380-4fbd-9276-ca8801807cda None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.712372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba9a2-d380-4fbd-9276-ca8801807cda None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.713314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ba9a2-d380-4fbd-9276-ca8801807cda None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.715131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 197/387] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:48.721141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.721601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.722033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.742066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:48.743633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:48.764513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e8508-21d0-47e9-bdc4-b5521a55dfe3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:48.830373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:48.840955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:48.852111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 191/388] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:48 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:48.852563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:48.859924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 198/389] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:48.861051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:48.869477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.035415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e942a-8a6c-455e-9b9f-d2a741d43967 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.072128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.073066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.073487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.074003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.075374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.077026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.078925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 199/390] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:48 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:49.084925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.096363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb606f1b-d75e-4c43-9fc7-194f6e02f88f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.142274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.192426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7aa2-5b48-4de7-84c2-681857b32ce8 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.194674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.195731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.196202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.196678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.208194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:49.214186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:49.215062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:49.215855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:49.218290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 192/391] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:49.219259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.229999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.230771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.231228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.231642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/groups/7143a83870004902ba78f3413d2135ff/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.233919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, group_id=7143a83870004902ba78f3413d2135ff, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.235600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.293112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.303392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 200/392] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 14:35:49 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/groups/7143a83870004902ba78f3413d2135ff/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:35:49.310462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.365095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611aaa5b-747c-4036-b979-4409e4891e8f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.443370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.444010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.444284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.444553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.470824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:49.477760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:49.478682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:49.479458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:49.485760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 193/393] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:49.492080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.521640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d634450-bfa2-432e-93c1-393ebfb3cb5c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.533523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.562400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.562961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.563343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.563787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.564613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:49.565056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.566673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.576765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 201/394] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:49.582998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.610795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7a160-2a20-4480-a8bf-fd5acb6beea3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.641830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.650956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.651795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.651997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.653874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.653874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:49.653874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.654733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.668440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 194/395] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:49.670796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.775451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2b1b7-adc3-4601-a108-a77b6aa26223 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.778933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e9dd0-62ad-48d6-8c3f-c754e3287d23 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:49.839689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.840331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.840612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.840904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.842085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.843748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.846015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 202/396] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:49.847379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:49.848026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:49.848305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:49.848579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:49.851141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.853296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:49.854996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:49.857902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 195/397] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:49.867099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:49.927144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:49.972966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.018919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d534e68-0a8d-41f1-8d7f-358dafc24bda None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.045925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3100cec-0222-40fa-a2a2-637b5481a74d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.057984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.059129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.059647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.060195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.061745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:50.063850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040f687-ac60-4eff-b0a2-ed47c056d626 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:50.071982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 196/398] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:50.072757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33eea-b5e4-48e6-a9f0-9c3b0e428e65 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.073304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33eea-b5e4-48e6-a9f0-9c3b0e428e65 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.073742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f33eea-b5e4-48e6-a9f0-9c3b0e428e65 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.075732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 197/399] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:50.076687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33eea-b5e4-48e6-a9f0-9c3b0e428e65 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:50.087600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.088198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.088586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.088954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.090232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:50.092290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89779245-d22f-4b18-8f0c-fa8bb9813759 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:50.094194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 203/400] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:49 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:50.095898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.096245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.096588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.115307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:50.116514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:50.187674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 204/401] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:50.192340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f33eea-b5e4-48e6-a9f0-9c3b0e428e65 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.193560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:50.223904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.231037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.231941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.232390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.232900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/groups/7143a83870004902ba78f3413d2135ff/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.235126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, group_id=7143a83870004902ba78f3413d2135ff, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:50.237102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaab4e1-f661-4aec-9592-b9d32cf6a211 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:50.254721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.318821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9a631-022e-4e8e-ad94-c357952014f8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.345856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 198/402] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 14:35:50 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/groups/7143a83870004902ba78f3413d2135ff/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:50.348124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355b1c-9ce4-433a-8a18-7917aeccf4ba None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.349107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355b1c-9ce4-433a-8a18-7917aeccf4ba None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.349553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57355b1c-9ce4-433a-8a18-7917aeccf4ba None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.355952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 199/403] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:50.358306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.358860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.359354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.373735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.374436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.374717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.374993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/groups/7143a83870004902ba78f3413d2135ff/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.385521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6f4d6f5432d49f684a1e59887e0b657, group_id=7143a83870004902ba78f3413d2135ff, role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:50.387172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:50.394128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:50.395717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:50.475256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 200/404] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:50.497563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 205/405] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 14:35:50 2022] PUT /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657/groups/7143a83870004902ba78f3413d2135ff/roles/f9509a8b59544a6ca684faad78f1d96f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:50.553395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:50.683243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5606fb-d9be-425e-bda9-6a2f12fa589b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.711131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.733112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.733776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.734050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.734317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.752604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:50.757730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:50.759303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:50.760572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 201/406] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:50.765768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:50.781596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:50.893577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eff789-948c-44e5-8e2d-a5d372dd1441 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.897012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:50.936075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:50.937114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:50.938523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:50.939028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:50.940979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:50.942186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:50.943786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:50.952640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ad66a-5e56-470b-b6f7-3092d47806c5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:50.960068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 206/407] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:50.966408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.016670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.017707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.018169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.018672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.044995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:51.050186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:51.051060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:51.051839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:51.058596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 202/408] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:35:51.063750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.129633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f5250-f248-4009-ad0a-6a0e41ff5a9d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.166090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.167072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.167563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.168072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.169461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.169907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:51.171254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.173439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 207/409] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:50 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:51.183888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.238234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:51.249632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93131de2-642d-4215-8753-615bdacabec5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.330628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.331498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.331921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.332347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.333181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:51.333628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.335136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.342070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f3f0-f5d4-4cf1-b67f-a3fc1cca6c65 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.354125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 203/410] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:51.360841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.389859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.390499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.390775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.391043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.393292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.394749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.405050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 208/411] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:51 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:51.405956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.521575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:51.529185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c2d40-f9f4-414b-bd5f-4e635c41c0d2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.578955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:51.585429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.586090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.586899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.587166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/groups/7143a83870004902ba78f3413d2135ff/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.588089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93410d7-0d77-4ccf-acaf-89de3fc3a080 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.593997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4753fd4c9b9404eb0bac8ecb1830412, group_id=7143a83870004902ba78f3413d2135ff, role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.598615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed056c-a4ce-4ad2-a185-1a26668739a3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.633167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.634316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.634644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.634969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] PATH_INFO: `/v3/groups/3a55adfa621d4cecaf535910b93a5d1d` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.636162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] RBAC: Authorizing `identity:get_group(group_id=3a55adfa621d4cecaf535910b93a5d1d)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.637611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.639566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 204/412] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:51 2022] GET /identity/v3/groups/3a55adfa621d4cecaf535910b93a5d1d => generated 229 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:51.644944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.682246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 209/413] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 14:35:51 2022] PUT /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412/groups/7143a83870004902ba78f3413d2135ff/roles/f9509a8b59544a6ca684faad78f1d96f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:51.683848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853d70-65d4-41ee-9c5f-1fb69369c84d None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.684239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853d70-65d4-41ee-9c5f-1fb69369c84d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.684614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853d70-65d4-41ee-9c5f-1fb69369c84d None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.686187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 210/414] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:51.693067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.693451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.693820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.745314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:51.749607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:51.814562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbc84c-deac-4c16-a1f5-099220ab4f0b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:51.871319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 211/415] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:51.878745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:51.879632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:51.880118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:51.880589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] PATH_INFO: `/v3/projects/08e00cc0e88b4e1a866763955e5979af` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:51.882009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] RBAC: Authorizing `identity:get_project(project_id=08e00cc0e88b4e1a866763955e5979af)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:51.883755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:51.885934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 205/416] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:51 2022] GET /identity/v3/projects/08e00cc0e88b4e1a866763955e5979af => generated 344 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:51.891822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:51.985967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:52.001999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcbf0d-ff76-4911-81ed-e142dfe3cc59 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:52.040740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:52.041414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.041734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.042004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] PATH_INFO: `/v3/projects/08e00cc0e88b4e1a866763955e5979af/groups/3a55adfa621d4cecaf535910b93a5d1d/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.044155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] RBAC: Authorizing `identity:create_grant(project_id=08e00cc0e88b4e1a866763955e5979af, group_id=3a55adfa621d4cecaf535910b93a5d1d, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:52.045684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:52.125014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 212/417] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 24 14:35:51 2022] PUT /identity/v3/projects/08e00cc0e88b4e1a866763955e5979af/groups/3a55adfa621d4cecaf535910b93a5d1d/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:35:52.199915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:52.246795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:52.340474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94668d53-cd23-4017-8412-c20ec188e409 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:52.378750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:52.379321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.379593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.379859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.392181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:52.398885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:52.400006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:52.400907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 206/418] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:52.405956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:52.531908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded78c0-ff91-4e87-8896-15b0fa6e4706 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:52.568036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:52.568646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.568946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.569217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.569888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] RBAC: Adding query filter params (name=member) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:52.570188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:52.572190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f1a97-2d09-4ad8-b2c7-0868bfc0145d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:52.581211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 213/419] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:52.587432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:52.599074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4cb7c-60e9-4302-b57a-0f3f402e35f5 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.599358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4cb7c-60e9-4302-b57a-0f3f402e35f5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.599603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4cb7c-60e9-4302-b57a-0f3f402e35f5 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.601222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 214/420] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:52.611047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360c10-193c-4340-b93e-58f41e8aa66d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.611323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360c10-193c-4340-b93e-58f41e8aa66d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.611593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28360c10-193c-4340-b93e-58f41e8aa66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.636966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-28360c10-193c-4340-b93e-58f41e8aa66d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:52.638153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-28360c10-193c-4340-b93e-58f41e8aa66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:52.640275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:52.711886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:52.727968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43043d-367e-4d10-8ae7-464d4403ebd7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:52.741901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 215/421] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:52.815043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:52.815661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.815938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.816208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.912237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:52.913663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:52.951724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457d700-ed52-44fd-a546-027e80d53983 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.952353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457d700-ed52-44fd-a546-027e80d53983 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.952850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457d700-ed52-44fd-a546-027e80d53983 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.954646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 216/422] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:52.962261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:52.962589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:52.962860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:52.999518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:53.000745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:53.065955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.074190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 207/423] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:53.079680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.113625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 217/424] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:53.120209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.197153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.234874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e7e6c-8c8d-4571-9598-9204d8f9513c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.273541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e190-eaeb-46ec-b6c6-c0ba8f72b956 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.274568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.275704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.276189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.276668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.278027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:53.279676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:53.282790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 218/425] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:53.295043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.381958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.382719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.382932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.383245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.404789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193e50a-4ff7-49ad-961b-16e54ebb2364 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.425324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:53.430937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:53.431841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:53.433239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 208/426] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:53.443487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.446854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.448393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.448912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.449378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.450744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:53.453403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:53.455358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 219/427] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:53.467860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.485061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.547272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.598573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc06400-2bc0-4e22-9859-0535bde9a02e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.637043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.637667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.637953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.638342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.639086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] RBAC: Adding query filter params (name=member) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:53.639399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:53.641154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:53.641920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ff2d3-fa17-4684-a7c4-2468e21bcf12 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.650670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 209/428] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:53.652358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.686885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.687814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.688351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.688639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.689420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:53.689733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:53.692164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:53.705053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 220/429] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:53.706827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:53.838332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.866631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c7980-14cb-41bb-a8f5-f76e66fc7379 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.880495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a945f5-3ca0-4a73-99c9-cf15c67b2b84 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:53.903477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:53.922439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.923207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.923493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.923760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.938019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:53.938657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:53.938937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:53.939421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:53.953673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:53.959204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:53.960153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:53.961245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 210/430] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:53.968571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.007155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.009565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79353f-7df3-4154-a4cf-b4b76dd32aa7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.092128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.094709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9866406-37fa-4222-bf45-85c9b9fca1d7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.135881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.136558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.136865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.137137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.137241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 221/431] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:54.137809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:54.138117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.138385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb64b0-a364-4c08-ba5e-03a58c43e26a None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.138687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb64b0-a364-4c08-ba5e-03a58c43e26a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.138926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb64b0-a364-4c08-ba5e-03a58c43e26a None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.139618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702244f-6019-4b0c-80fe-5b57e82200fc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.140370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 222/432] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:54.145377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb64b0-a364-4c08-ba5e-03a58c43e26a None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.151376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 211/433] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:54.152661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.152967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.153237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.178767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:54.180039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:54.220124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.265478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 212/434] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:54.266342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.295292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb64b0-a364-4c08-ba5e-03a58c43e26a None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.340917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.341902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.342528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.343055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.344514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.346474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.351477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 223/435] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:54.354986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.385122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d11370-0d67-4466-9e95-dabad4af958a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.399765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.422411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.423020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.423289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.423560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.460987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.478997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab201846-c0c2-46fe-9799-2b33239979fd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.500515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.502111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.519893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256121fd-011b-4489-8483-b0184d376412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.520940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256121fd-011b-4489-8483-b0184d376412 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.521511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256121fd-011b-4489-8483-b0184d376412 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.522093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256121fd-011b-4489-8483-b0184d376412 None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.523504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256121fd-011b-4489-8483-b0184d376412 None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.527360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256121fd-011b-4489-8483-b0184d376412 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.530221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 224/436] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:54.542249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256121fd-011b-4489-8483-b0184d376412 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.613384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 213/437] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:54.614228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.660258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256121fd-011b-4489-8483-b0184d376412 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.662529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.682076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.693802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.694876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.695439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.696796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.697565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=268d6b86cbf444be9d29d3be41ba5e3f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:54.697878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.699360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.705207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 225/438] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=268d6b86cbf444be9d29d3be41ba5e3f => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:54.705981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.715979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238e3a1-6ad7-487d-87a8-e2fdd1de1ba3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.756571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.757540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.757827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.758708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.772675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1e960249-8a2a-4c7c-a42b-54d97bd190ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:54.778727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:54.779867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:54.780643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 214/439] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:54.781362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3952c4-30d0-4dca-ae2b-70ca3a05f7be None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.781433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3952c4-30d0-4dca-ae2b-70ca3a05f7be None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.782047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3952c4-30d0-4dca-ae2b-70ca3a05f7be None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.787063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 215/440] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:54.787063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3952c4-30d0-4dca-ae2b-70ca3a05f7be None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.825252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697ceab-306b-4dc8-ad1f-7e33bce8c30e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.889122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.889768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.890026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.890369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] PATH_INFO: `/v3/projects/a6f4d6f5432d49f684a1e59887e0b657` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.891414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] RBAC: Authorizing `identity:get_project(project_id=a6f4d6f5432d49f684a1e59887e0b657)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.892899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cfbbe-da09-475b-8919-a3978baf06a6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.894711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 226/441] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/projects/a6f4d6f5432d49f684a1e59887e0b657 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:54.895611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.895888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.896154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.914828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:54.916021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:54.920072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3952c4-30d0-4dca-ae2b-70ca3a05f7be None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:54.944982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.947690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:54.955052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:54.955663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:54.955943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:54.956216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:54.956909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:54.957213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:54.958587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:54.967294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 216/442] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:54.968087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:54.983913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 227/443] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:54.984774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.076960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bbf4de-51b4-4944-af9f-a79a521eafbe None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.103591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb5f4d-3286-4823-bbaf-58b2e509d5cd None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.114279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.114913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.115190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.115460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.116580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.118674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.120465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 217/444] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:55.126113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.145934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.146542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.146843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.147114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.184738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.188469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.219653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.221410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.234052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8e9e3-8d73-4612-8237-9f1a961149cb None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.273374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.274078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.274290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.274565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.275296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=a6f4d6f5432d49f684a1e59887e0b657) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:55.275608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.277087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.283127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 218/445] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=a6f4d6f5432d49f684a1e59887e0b657&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:55.283918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.327253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 228/446] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:35:55.333202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.404542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54100d-13bf-48d5-8dbf-b508f1d2fdc1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.413029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.430607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.443123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.443751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.444042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.444306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.457657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a3cd8-8e8d-4e22-ad4c-1c0941843d60 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.458416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:35:55.464036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:55.465080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:35:55.466165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:55.466943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 219/447] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:55.472826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.507624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.508961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.510754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.510754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] PATH_INFO: `/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.513396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] RBAC: Authorizing `identity:get_project(project_id=b4753fd4c9b9404eb0bac8ecb1830412)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.514935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.516579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 229/448] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/projects/b4753fd4c9b9404eb0bac8ecb1830412 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:55.522061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.606765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15973478-7691-45c9-a44f-2341a986d6be None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.650424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.651090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.651296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.651592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.652294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:55.652564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.653950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f42ac-a198-40fe-8d7c-59d0524abfeb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.654069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.663169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 220/449] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:55.670641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.696516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.697200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.697473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.697739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] PATH_INFO: `/v3/groups/7143a83870004902ba78f3413d2135ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.698878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] RBAC: Authorizing `identity:get_group(group_id=7143a83870004902ba78f3413d2135ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.700331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.702242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 230/450] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/groups/7143a83870004902ba78f3413d2135ff => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:35:55.708049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:55.710960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.725091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:55.796943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d5557-bc1e-4a7c-ad04-9a9b71ce2d89 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.829684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76750205-cbe6-40ed-a3e4-ad65cc4f787a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:55.837589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.838203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.838479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.838751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.864306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:55.864862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:55.865141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:55.865436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:55.866157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] RBAC: Adding query filter params (group.id=7143a83870004902ba78f3413d2135ff, role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:55.866470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.868609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.874294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 231/451] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/role_assignments?group.id=7143a83870004902ba78f3413d2135ff&scope.project.id=b4753fd4c9b9404eb0bac8ecb1830412&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:55.909839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:55.911318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:55.959495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:56.017611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 221/452] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:35:56.023536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:56.091124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:56.126975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a42366-020c-4210-993a-07ba3cd315bd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:56.164477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:56.165566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.166007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.166472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] PATH_INFO: `/v3/projects/08e00cc0e88b4e1a866763955e5979af` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.167878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] RBAC: Authorizing `identity:get_project(project_id=08e00cc0e88b4e1a866763955e5979af)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:56.169592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:56.171548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 232/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:35:56 2022] GET /identity/v3/projects/08e00cc0e88b4e1a866763955e5979af => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:56.177324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:56.281179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd830ab-8518-4359-8a67-51fcca8a34fc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:56.315318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:56.315936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.316208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.316476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] PATH_INFO: `/v3/groups/3a55adfa621d4cecaf535910b93a5d1d` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.317593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] RBAC: Authorizing `identity:get_group(group_id=3a55adfa621d4cecaf535910b93a5d1d)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:56.319015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbd1bf-91f3-47e4-9586-d637881dfacb None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:56.320949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 222/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 24 14:35:56 2022] GET /identity/v3/groups/3a55adfa621d4cecaf535910b93a5d1d => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:56.326618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:56.439615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d38eb-dc2b-4fb8-bf52-c7bce0faf42c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:56.471938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:56.472525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:56.472830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:56.473099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:56.473811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] RBAC: Adding query filter params (group.id=3a55adfa621d4cecaf535910b93a5d1d, role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=08e00cc0e88b4e1a866763955e5979af) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:56.474112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:56.475541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1bc85-ff3e-409f-bae3-5dec150497ef None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:56.477750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:56.482027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 233/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 24 14:35:56 2022] GET /identity/v3/role_assignments?group.id=3a55adfa621d4cecaf535910b93a5d1d&scope.project.id=08e00cc0e88b4e1a866763955e5979af&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:58.744329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ecd07-39c6-4bcd-92f6-58984b5e2f8a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:58.744842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ecd07-39c6-4bcd-92f6-58984b5e2f8a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:58.744842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ecd07-39c6-4bcd-92f6-58984b5e2f8a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:58.746396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 223/456] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:58.752033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b7ecb-7a29-4be4-89f9-6cda0d6ddce1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:58.752435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b7ecb-7a29-4be4-89f9-6cda0d6ddce1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:58.752573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b7ecb-7a29-4be4-89f9-6cda0d6ddce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:58.772724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4a2b7ecb-7a29-4be4-89f9-6cda0d6ddce1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:58.774762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4a2b7ecb-7a29-4be4-89f9-6cda0d6ddce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:58.859403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 234/457] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:35:58.921458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c234bb-e7ef-466a-885b-630f0275ad84 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:58.921764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c234bb-e7ef-466a-885b-630f0275ad84 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:58.922007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c234bb-e7ef-466a-885b-630f0275ad84 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:58.923336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 224/458] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:58.938337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542a39-8bb7-4b36-82a0-54c1586b0224 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:58.938613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542a39-8bb7-4b36-82a0-54c1586b0224 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:58.938878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e542a39-8bb7-4b36-82a0-54c1586b0224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:58.963202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5e542a39-8bb7-4b36-82a0-54c1586b0224 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:58.964396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5e542a39-8bb7-4b36-82a0-54c1586b0224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:59.051103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 235/459] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:59.207302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c234bb-e7ef-466a-885b-630f0275ad84 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:59.224394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:59.334310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c234bb-e7ef-466a-885b-630f0275ad84 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:59.378354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f69b89-126e-4487-a141-ab6da889e25e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.378655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f69b89-126e-4487-a141-ab6da889e25e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.378898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f69b89-126e-4487-a141-ab6da889e25e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.380539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 236/460] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:59.386041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838737b-5d8c-4871-a10e-c87763442ed8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.386571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838737b-5d8c-4871-a10e-c87763442ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.387031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d838737b-5d8c-4871-a10e-c87763442ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.390304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:59.390926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.391199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.391466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.407461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d838737b-5d8c-4871-a10e-c87763442ed8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:59.409640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d838737b-5d8c-4871-a10e-c87763442ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:59.409896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:59.411552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d1188dcc-84c7-4426-982e-72cb20120d26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:35:59.438948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:59.439899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:35:59.440805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:35:59.440805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:35:59.440805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:35:59.440805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 225/461] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:59.446121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b60f-97db-43b7-af3c-1aa210845100 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.446479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b60f-97db-43b7-af3c-1aa210845100 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.446712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789b60f-97db-43b7-af3c-1aa210845100 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.448108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 226/462] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:35:59.449257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b60f-97db-43b7-af3c-1aa210845100 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:59.477718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:59.496745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 237/463] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:59.496745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.496745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.496745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.525981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:35:59.528346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:35:59.573130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:59.581385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789b60f-97db-43b7-af3c-1aa210845100 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:59.604960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 238/464] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:35:59.605807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:59.624878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:59.625930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.626411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.626928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.627848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:35:59.628443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:59.630177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:59.648064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 227/465] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:35:59.656649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:59.730530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751373b-8738-4684-9f09-d9a94d342fc5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:59.756546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:59.769472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:59.771733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.771733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.771733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.797239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:59.798782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:35:59.820490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:35:59.821613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:35:59.822468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:35:59.822468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:35:59.822468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:35:59.824917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 239/466] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:35:59.829204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:35:59.855221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ea17b-dd31-4c37-805f-ec3abb900413 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:59.881151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:35:59.892632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:59.893540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.893960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.897729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.897729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:59.897729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:35:59.948044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ef2e7-ec05-41d1-8a35-f811c4736016 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:35:59.984261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:35:59.984911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:35:59.985186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:35:59.985447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:35:59.996069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:35:59.997546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:00.011969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:00.017695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:00.018558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:00.018558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:00.018558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:00.018558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 240/467] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:00.018558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.042161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:00.045936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 228/468] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:35:59 2022] POST /identity/v3/users => generated 246 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:00.058032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.143036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c1bc1-d990-4b19-8f8f-0853a88d37cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.201251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaba86c-68cd-4a67-b772-c48f1bea8314 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.202379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.203006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.204128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.204467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.205568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:00.205568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.206831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.225572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 241/469] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:00.226262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.247177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.248286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.248633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.248941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.262224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.264528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:00.280742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:00.281906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:00.282898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:00.282898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:00.282898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:00.282898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 229/470] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:00.286973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.334327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:00.336959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:00.361505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16981f27-a9c6-41c7-8d3e-60a52ea21a1d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.409264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.409778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.410054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.410350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.411005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:00.411282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.412643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.430335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 242/471] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:00.431282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.438541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c95a8-dbd8-4a3d-bb36-3ca1dab2d7e4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.493564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.494794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.495659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.496129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.497029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.499267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.552653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05a84d-864f-4496-a053-703a4ae61fa5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.591725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.592328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.592604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.592901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.593543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:00.593846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.595227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80c2a-1f18-40c5-9ac2-a2cd2a4015da None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.608115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 230/472] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:36:00 2022] POST /identity/v3/users => generated 248 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:00.608115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.613755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 243/473] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:00.615326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913e5b-1ea7-4303-8d40-ad2068957d04 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.615616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913e5b-1ea7-4303-8d40-ad2068957d04 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.615890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63913e5b-1ea7-4303-8d40-ad2068957d04 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.617566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 244/474] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:00.619062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63913e5b-1ea7-4303-8d40-ad2068957d04 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:00.622601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:00.746251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:00.754753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63913e5b-1ea7-4303-8d40-ad2068957d04 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.763991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8702-aa33-4bf0-864d-0aefec2e4c11 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:00.796018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.796623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.796951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.797218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.797866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.799322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649b4c1-38fc-426c-b385-e39115da7a3a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.804189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:00.805021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.805397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.806363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.806363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:00.807802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:00.913337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 245/475] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:36:00 2022] POST /identity/v3/users => generated 249 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:00.915126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90430-048b-4778-8666-a9894b71b448 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:00.915609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90430-048b-4778-8666-a9894b71b448 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:00.915816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90430-048b-4778-8666-a9894b71b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:00.936254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-def90430-048b-4778-8666-a9894b71b448 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:00.937812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-def90430-048b-4778-8666-a9894b71b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:00.943942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 231/476] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:36:00 2022] POST /identity/v3/users => generated 248 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:01.029818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:01.048978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 246/477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:01.391855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:01.547846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfc001-0b22-40f9-89fc-5769ac5a3f56 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:01.596397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:01.597051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:01.597335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:01.597607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:01.598276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:01.599658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:01.657489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.sql.core [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:36:01.657489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 14:36:01.657489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [parameters: {'id': '6e1e1daa988c4c4dad9baec4346eb19f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 14:36:01.657489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88268) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:01.676757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:01.684408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application yield resource Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise self.value Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application session.commit() Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:36:01.685396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:36:01.686263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:01.687154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:01.687990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [parameters: {'id': '6e1e1daa988c4c4dad9baec4346eb19f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:01.689004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 14:36:01.689824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:01.690698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 232/478] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 14:36:01 2022] POST /identity/v3/roles => generated 144 bytes in 291 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:01.695869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90430-048b-4778-8666-a9894b71b448 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:01.872072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90430-048b-4778-8666-a9894b71b448 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:01.931378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:01.932282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:01.932706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:01.933136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:01.948736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-35b5c6ba-3190-4428-bcc7-58b499c2734a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:01.957399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:01.958517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 14:36:01.959515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:01.968757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 247/479] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:01.974099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:02.003145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:02.144761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbfc06-b45a-456b-8dd6-2086fad4b748 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:02.186492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:02.187333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:02.187756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:02.188167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:02.189010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:02.189470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:02.190983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c5916f-4fe5-4af2-8223-2833500cad3c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:02.205634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 233/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:02.451276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93848-61b2-43ac-bb31-87e76ccce0df None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:02.451770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93848-61b2-43ac-bb31-87e76ccce0df None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:02.452206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93848-61b2-43ac-bb31-87e76ccce0df None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:02.453732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 248/481] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:02.460232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf6a5-562c-40c7-a3c6-108a1725674d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:02.460540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf6a5-562c-40c7-a3c6-108a1725674d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:02.460844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbf6a5-562c-40c7-a3c6-108a1725674d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:02.483958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d9dbf6a5-562c-40c7-a3c6-108a1725674d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:02.485387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d9dbf6a5-562c-40c7-a3c6-108a1725674d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:02.574432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:02.582571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 234/482] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:02.941733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e93848-61b2-43ac-bb31-87e76ccce0df None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.002543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:03.053673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12997-d296-4bb8-88c8-b06e7f26b92f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.054183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12997-d296-4bb8-88c8-b06e7f26b92f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.054183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12997-d296-4bb8-88c8-b06e7f26b92f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.056556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 235/483] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:03.061755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e93848-61b2-43ac-bb31-87e76ccce0df None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.061888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.062104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.062418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.099432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.100195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:03.100934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.101437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:03.101727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.102476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.113816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:03.119053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:03.119956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:03.120835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:03.128031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 249/484] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:03.129559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.240801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 236/485] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:03.288617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f9bfa-c5eb-484f-a825-ae41914e757f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.301068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:03.325560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.326526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.326996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.327454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.328412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:03.328929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:03.330491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:03.343982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 250/486] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:03.345901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.504734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd399-7a93-4e13-82a9-ca392dc037cd None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.541302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:03.548176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.548836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.549115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.549400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.570004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:03.572511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:03.588778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:03.589705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:03.590584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:03.590584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:03.590584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:03.590584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 237/487] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:03.594572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.596464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.706682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da676db3-34fa-4b9b-a5a5-539656d4fe2c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.713273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34288816-0c1c-4d97-ad3a-ecb95d86518e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.744667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.745338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.745618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.745991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.746780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:03.747092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:03.748522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689c100-f6de-4590-adac-73343f5125e0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:03.752003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.752661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.753043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.753314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.762772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 238/488] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:03.764027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07082d-0b4b-46aa-bfa7-b4aee4e4b6d4 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.764310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07082d-0b4b-46aa-bfa7-b4aee4e4b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.764582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07082d-0b4b-46aa-bfa7-b4aee4e4b6d4 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.766055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 239/489] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:03.770370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:03.771417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07082d-0b4b-46aa-bfa7-b4aee4e4b6d4 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-7e8f1c80-5c5e-4bee-8f50-219d50bc83f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:03.776210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:03.777213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:03.777996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 251/490] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:03.779182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.779182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.779332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.799451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:03.801040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:03.831898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:03.854994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:03.880845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 252/491] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:03.881996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.911608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07082d-0b4b-46aa-bfa7-b4aee4e4b6d4 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:03.948897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:03.949521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.949803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.950074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.957611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:03.959068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-9fd422f3-fa16-446d-a84a-c1c9805ada37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:03.973279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:03.974217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:03.975116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 240/492] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:03.980610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7ef0-e6ec-414c-9d99-9fdc8362021f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:03.980941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7ef0-e6ec-414c-9d99-9fdc8362021f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:03.981216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a7ef0-e6ec-414c-9d99-9fdc8362021f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:03.986796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 241/493] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:03.987410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7ef0-e6ec-414c-9d99-9fdc8362021f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:03.998380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82b805b-0854-429f-b8fb-7c8dbe3ab7e2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.035081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.035600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.035877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.036148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.036853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:04.037147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.038588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a5145-f8b3-4093-8d0d-b5f777bb4637 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.055264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 253/494] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:04.055264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.055264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.055264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.073196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:04.074684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:04.094131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.118289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a7ef0-e6ec-414c-9d99-9fdc8362021f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.120555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.156739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 254/495] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:04.156739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.185613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.186227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.186503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.186772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.188161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:04.188471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.191222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.240903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 242/496] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:04.241847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.275868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b5347-2a0a-4447-8115-2fa9dbff8fa7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.311281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.311827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.312099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.312465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.323164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.324755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:04.340820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:04.341730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:04.342558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:04.342558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:04.342558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:04.342558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 255/497] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:04.343182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.347469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.351045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49039a2-d6c9-4f9f-bc21-c950269d941e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.390826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.391662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.392128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.392577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.404467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:04.409960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:04.410963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:04.411747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:04.413858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 243/498] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:04.415816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.440064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.460194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83247e9-da89-4e72-b656-c35cc79b15a7 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.496957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.497564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.497836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.498107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.530826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c92bd-9507-42cf-be20-35c446a9c290 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.566298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.566298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.566298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.566619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.567054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:04.567353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.568765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.571010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.572464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.576449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.581136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 244/499] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:04.587361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.676561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.677960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 256/500] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:04.678812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.696559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec742-8399-4898-85d2-1ab35821de9f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.730625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.731234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.731515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.731795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.732462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:04.732784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.734165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.741908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 245/501] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:04.742720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.781888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3f54c-4b09-4a12-bdc5-6cb1189bbf17 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.784129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.814698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.815324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.815600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.815868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.827031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a15194bd-66b1-4b0e-8e5b-af0c86b570d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:04.831665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:04.832669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:04.833494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 257/502] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:04.834157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e14c-52db-4284-93db-a124649b0749 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.834157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e14c-52db-4284-93db-a124649b0749 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.834472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21e14c-52db-4284-93db-a124649b0749 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.835641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 258/503] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:04.836379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21e14c-52db-4284-93db-a124649b0749 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.850265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06176b06-0081-4f56-874d-c689d12b9289 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.885023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.885649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.885927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.886196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.893594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.895050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:04.906093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:04.907009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 246/504] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:04.907899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:04.910563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:04.938401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21e14c-52db-4284-93db-a124649b0749 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:04.972210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:04.972891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:04.973169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:04.973436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:04.984007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:04.985516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:04.999821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:05.001146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:05.001995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:05.001995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.001995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:05.001995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 259/505] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:05.001995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.012846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05745b-6162-46fe-9f6b-99537519b604 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.021427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.046576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.047209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.047490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.047763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.059130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.060591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a7add8f3-4269-4cd6-adf6-68b9d6c50305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:05.075089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:05.076009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:05.076898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:05.076898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.076898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:05.076898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 247/506] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:05.077449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.077687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.077959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.095358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:05.096855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:05.106377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfee3d0-0194-4016-8e86-70b54fd94131 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.140452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.141085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.141366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.141640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.142310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:05.142614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.144004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.146247 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.151974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 260/507] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:05.152804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.164628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 248/508] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:05.165497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.246361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.268493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc545a1-d379-441e-877a-071447d6c6d0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.275546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14505c-5350-4fc7-8b60-e114dac4f887 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.305516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.306117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.306391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.306662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.307416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:05.307768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.309329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.312528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.313169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.313444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.313712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.314353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:05.314651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.316046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.332065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 249/509] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:05.332065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.351083 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 261/510] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:05.351083 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.391707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.460546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004bc05-4ead-4851-b38d-2c2a70672721 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.471269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ccc03-d70e-4b6f-bc38-cbe46882ff94 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.499912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.500519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.500836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.501117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.501756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:05.502058 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.503469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.509824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.510855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.511223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.511497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.514266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.515851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 250/511] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:05.516688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.525697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.527687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:05.544257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:05.545534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:05.546822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:05.546822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.546822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:05.546822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 262/512] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:05.546822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.634728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4aed-d9d3-470f-9ca1-724d5fd3cc3f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.637587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.671412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb9a750-6470-4129-9d85-05241e91ef61 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.676290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.677093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.678349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.678647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.687620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.689709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:05.706318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:05.707385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 251/513] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:05.708254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.727415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.728208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.729000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.729000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.797387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:05.809852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.811408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.835210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df3c1c-8eeb-412c-9231-936a318d6c2b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:05.875787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:05.876417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:05.876696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:05.877003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:05.888840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:05.890231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:05.905080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:05.905979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:05.906833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:05.906833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:05.906833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:05.906833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 252/514] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:05.907055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.920067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 263/515] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:05.920939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:05.929217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.009200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.010644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309368e-4987-4c9f-a60d-870365858411 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.020838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831e3a9-be51-4559-aaf2-eb29ce760a0f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.045681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.046303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.046581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.046854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.053794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.055258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.057599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.058191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.058466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.058732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.059400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.059697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.061085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:06.066514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:06.067448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:06.068343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 253/516] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:06.068946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.074677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 264/517] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.075548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.149233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.171423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bebeb-96e3-4297-848f-246ffb1d67d5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.174809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb593d-76d4-469a-85a5-4fb6e0e0f6ef None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.206233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.206832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.207106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.207375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.208056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.208358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.209835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.210025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.210578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.211448 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.211731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.212367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.212668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.214086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.225781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 265/518] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.226618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.229632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 254/519] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.230562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.238946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd67aa-29da-4ed4-89bb-7f7bcfa340c1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.336926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d95194-8d9a-4376-ab29-16488d6765d0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.361403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.362026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.362304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.362578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.371075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.371684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.371967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.372239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.373006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.373316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.374543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.374755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.376012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.381560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:06.391718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:06.399758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:06.400608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:06.400608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:06.400608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:06.400608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 266/520] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:06.400849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 255/521] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.400917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.400980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.457466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.497209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69c42e-ae28-4263-8365-076d331ef59d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.499402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9466c-2b71-4a6c-b379-0a24ed7ae539 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.532521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.533172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.533445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.533712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.534888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.535599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.535773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.536044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.536695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.538275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.542266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.543735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:06.556539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:06.557631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:06.558512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 267/522] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:06.559060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.644120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 256/523] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:36:06 2022] POST /identity/v3/users => generated 247 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:06.645098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.667784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a5407-b740-4d81-bf9d-9855f001b452 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.690645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.707660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.711851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.711851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.711851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.711851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.711851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.712935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.728748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 268/524] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.728748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.735711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:06.826380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df24dc4-3a79-4756-9a34-96b6f7d8624e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.875125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581c08-7084-4796-8c18-a886eb1ad01f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:06.895783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.896422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.896797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.897077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:06.902208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:06.902533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:06.904594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:06.925194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 257/525] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:06.926182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:06.926561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:06.927394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:06.927845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:06.928289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.012290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.021293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.024246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.054405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde9c81-4cc2-4635-bb5e-644c72b5917b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.071993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.106020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.106925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.107374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.108329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.109273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:07.109777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.112195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.137723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 269/526] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:07.138499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.139286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 258/527] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 14:36:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:07.143297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.260681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.277476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0c2a-eb82-4e2d-a384-01a675de89cd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.294599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c1933-967b-4f1c-beb7-def7272a1dc7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.317788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.318647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.319094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.319507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.329950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.331498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.341354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.342168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.342589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.343069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:07.344323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:07.345433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:07.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:07.348432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 270/528] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:07.349556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.359781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.362127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:07.381365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:07.382504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:07.384441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:07.384441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:07.384441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:07.391236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 259/529] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:07.392376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.416856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.464848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e1c31-2c97-42f7-a8b4-bd8fe294cf1c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.500861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.501547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.501928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.502300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.506739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde96ee4-fee6-4094-b5b7-73b7c2686f17 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.517271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.544405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.545266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.545685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.546121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.546937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:07.547390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.548986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.563091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 260/530] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:07.564262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.576447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.578289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.669947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.685363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 271/531] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:07.686508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.691755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dceabf-bcf7-479a-a2b1-b4cd41be4806 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.732142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.733090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.733604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.734153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:07.735215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.736035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:07.736535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.738138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.751062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 261/532] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:07.752550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.797341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98dc1d3-a88a-49cf-8988-98ca0e4c8e4a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.833396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.834003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.834279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.834547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:07.835855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=ae76bbd0c6b34ed996bc76c1f4a00e27) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:07.835855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:07.837441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:07.843978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 272/533] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/role_assignments?user.id=ae76bbd0c6b34ed996bc76c1f4a00e27&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:07.844941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:07.887019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db0263-89d5-4864-9a1e-1608de20e705 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:07.970320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:07.971256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:07.971535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:07.971789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.001013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.002529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.005646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:08.019633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:08.026739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:08.027594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:08.027594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:08.027594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:08.027771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e54a37-e1ed-4db7-9275-402701f0461e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.028161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 262/534] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:08.028161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.033210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:08.063943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.063943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.063943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.063943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.071467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.073261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:08.085359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:08.086269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:08.087133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:08.089635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 273/535] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:08.098105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.231051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424232-95fd-4d3f-80d6-ccded05cafda None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.256040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632e27-f898-4f97-8f9d-fdf07d1a8deb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.294528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.295151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.295669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.295669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.296321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:08.296639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.298998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.313122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.313731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.314064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.314277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.314978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:08.315281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.316733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.325603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 263/536] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:08.332456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.362017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 274/537] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:08.364385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.420952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:08.441365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:08.528560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88426dbd-eee7-4a19-bbe8-bd1211288fb1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.546095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7792a8f-5e2d-46a4-82d6-2577b624336c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.583373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.584377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.584963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.585434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.587003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4bb596b4e1074e5d85dec4ed71dc3052) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:08.587516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.589210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.596049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 275/538] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/role_assignments?user.id=4bb596b4e1074e5d85dec4ed71dc3052&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:08.602697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.602697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.602697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.602697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.617028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.618713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:08.641621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:08.642509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:08.643338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:08.644919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 264/539] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:08.649314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.762282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:08.771941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5ecbac-c490-4f38-9cf9-0bd4b186ff5b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.807328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:08.808647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.808968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.809247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.810002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:08.810786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:08.812830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4bc433-55f0-4073-8596-5be73f90c25c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:08.826493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 276/540] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:08.831876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:08.862650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab288-9414-4473-af01-d751581e8707 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.862882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab288-9414-4473-af01-d751581e8707 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.863108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaab288-9414-4473-af01-d751581e8707 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.864578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 277/541] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:08.871156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751f2-1ce1-4c70-86f1-c7b39a8f06ff None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:08.871432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751f2-1ce1-4c70-86f1-c7b39a8f06ff None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:08.871701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70751f2-1ce1-4c70-86f1-c7b39a8f06ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:08.909721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a70751f2-1ce1-4c70-86f1-c7b39a8f06ff None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:08.910929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a70751f2-1ce1-4c70-86f1-c7b39a8f06ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:08.973299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037aa484-804a-4f5e-81c0-d417fde3cc8e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:08.994243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:09.011061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 278/542] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:09.012640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70a65-2803-409a-85f4-1aa736dd9f60 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:09.012967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70a65-2803-409a-85f4-1aa736dd9f60 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:09.013241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70a65-2803-409a-85f4-1aa736dd9f60 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:09.018852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 279/543] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:09.020880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:09.021166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:09.021439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:09.038427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:09.038427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:09.038427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:09.038814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:09.039657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=aff851a161644ee0b97c18d2c30dc5a7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:09.040062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:09.041623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:09.043928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:09.045639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:09.059868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 265/544] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:08 2022] GET /identity/v3/role_assignments?user.id=aff851a161644ee0b97c18d2c30dc5a7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:09.125692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 280/545] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:09.365879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:09.493867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:09.516170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:09.531151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d8112-64d6-4f00-bf16-48f888984a50 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:09.598438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:09.599084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:09.599358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:09.599621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:09.633719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:09.678459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:09.680648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:09.681853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 266/546] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:09.686772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:09.767520 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:09.778682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517354fd-8ab1-4f2e-a67b-b0a3e1b66035 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:09.815653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:09.816286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:09.816565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:09.816869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:09.839424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:09.845180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:09.847070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:09.848293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:09.850874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 281/547] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:09.861794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:09.931192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0460e-0b1b-4cf4-b26d-3321b8c09fb8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:09.992865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.011648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.012860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.013353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.013643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.014914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:10.015616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.018957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.055238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 267/548] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:10.058195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.074723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a428e-07a3-4e22-afb0-b9c32d912474 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.181551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.182081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.182359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.182623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.183294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:10.183595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.185009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.208685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5d442-f34b-41c7-8b91-c108a8a34d40 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.212012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 282/549] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:10.212676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.233803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.254018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.254843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.256228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.256687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.276405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.278914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:10.303370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:10.305111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:10.306253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:10.306253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:10.306253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:10.306253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 268/550] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:10.315199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.442715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57580720-7ea8-49da-92a9-43c6e2f20887 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.461663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465ba50-9b74-4425-a1b7-937b36e07a55 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.489765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.490521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.490807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.491077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.494486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.503306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.504332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.517503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.517657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.517657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.517657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:10.517657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.517994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.518154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56818bd-ce0a-491e-97c0-18a998d8691a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.522788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 269/551] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:10.524503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:10.525627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:10.526687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:10.526687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:10.526687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:10.527102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90387150-9727-43ce-a3eb-f8fe393d060b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.527525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90387150-9727-43ce-a3eb-f8fe393d060b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.527918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90387150-9727-43ce-a3eb-f8fe393d060b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.529892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 270/553] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:10.530063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 283/553] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:10.530940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.533971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90387150-9727-43ce-a3eb-f8fe393d060b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.549348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.669304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90387150-9727-43ce-a3eb-f8fe393d060b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.676333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488b234-cfba-4484-84a2-ffe5f86f079d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:10.709826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.710339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.710612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.711617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.712603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:10.712886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.714696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658a86c-23d5-4cbb-9e12-0afc3768ec94 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.726995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:10.728258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.728936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.729361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] PATH_INFO: `/v3/users/swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.736466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 271/554] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:10.736466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:10.736466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:10.736466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:10.745413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:10.747145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:10.754151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:10.755514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:10.762321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:10.763476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:10.764627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:10.766959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 284/555] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:10.768236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.827700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.854608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:10.868762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 272/556] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:10.869028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:10.935776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42edb4ff-eaa6-4564-af54-39f49f35b36a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.009594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.010157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.010428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.010699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.027525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.030583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-03f7f7c6-e038-4978-9f67-48125f7b3fcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:11.049143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:11.050136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:11.051915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 285/557] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:11.052541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781fe5-e2e0-4e44-ad8b-96c075f56fca None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.052894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781fe5-e2e0-4e44-ad8b-96c075f56fca None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.054008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781fe5-e2e0-4e44-ad8b-96c075f56fca None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.056037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 286/558] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:11.065726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781fe5-e2e0-4e44-ad8b-96c075f56fca None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.068772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b0e73-1e35-4f60-a957-6acd346cca04 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.115249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.121015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a275544-d8b9-40d5-9f60-4f119c6e5c49 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.152476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 273/559] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:11.154603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.155188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.155880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.189101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:11.190852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:11.217759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781fe5-e2e0-4e44-ad8b-96c075f56fca None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.245211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.269384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.270230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.270711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.271122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.272025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:11.272974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.276272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.284451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.296780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 287/560] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:11.297955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.314993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 274/561] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:11.316301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.433080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856f6ac-db10-4c64-835d-4b1b855d1809 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.456282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6ead-3b7c-4c52-958e-9398d5c8bacb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.475628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.476286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.476558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.476942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.504635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.505432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.505708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.505981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.512501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.526474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:11.530383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:11.531532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:11.532594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:11.536909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 275/562] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:11.537857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.571173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.572937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.599063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.655106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64254b79-2878-4bfc-a778-0f2574753e0f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.689037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 288/563] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:11.689909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.690803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.691434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.691711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.691977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.702765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.704218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-47b935a7-dc90-43c9-b2be-07eccc664124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:11.719339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:11.720464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:11.721815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:11.721815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:11.721815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:11.721815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 276/564] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:11.722113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57cd15-3ada-4762-844c-d582375797a9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.722399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57cd15-3ada-4762-844c-d582375797a9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.722681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57cd15-3ada-4762-844c-d582375797a9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.728891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 277/565] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:11.728891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57cd15-3ada-4762-844c-d582375797a9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.758200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.795344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e49126-95ed-4d03-b9a5-36f9338fb8f4 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.829497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.830151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.830423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.830686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.831339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:11.831634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.833013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:11.841595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 289/566] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:11.842385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.850423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.854864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57cd15-3ada-4762-844c-d582375797a9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.889326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.889952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.890227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.890495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.901145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:11.905744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:11.906654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:11.907476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 278/567] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:11.908176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:11.946540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed73c685-c7e5-440d-a096-2ec6ada68e08 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:11.973768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:11.983868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833af08-f301-48e9-acbe-864510624921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:11.984488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833af08-f301-48e9-acbe-864510624921 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:11.984788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833af08-f301-48e9-acbe-864510624921 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:11.985056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833af08-f301-48e9-acbe-864510624921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:11.996424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833af08-f301-48e9-acbe-864510624921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:11.998209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833af08-f301-48e9-acbe-864510624921 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.012151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191dcf-8f9c-433f-bcdb-3afd1dee6274 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-4833af08-f301-48e9-acbe-864510624921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:12.014030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.014956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:12.016062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:12.016062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.016062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:12.016062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 290/568] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.016447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.016542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.017408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.034826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:12.036012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:12.049115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.049712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.049994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.050352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.051061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:12.051359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.052733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.064383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 279/569] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:12.065198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.089172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.104155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 291/570] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:12.104941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.172233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160ba0-4f8b-46a5-ab02-7371ea0ff163 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.208977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.209610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.209882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.210154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.217414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a693a-c277-4a43-a508-5d82e97615a2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.220617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.222344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.229899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:12.238695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.239615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:12.240528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:12.240528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.240528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:12.240528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 280/571] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.248286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.262085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.262696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.262981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.263254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.263922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:12.264228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.265693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.279414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 292/572] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:12.279414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.321989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.356054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531452b9-f23c-400b-9464-d2316156e3f1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.395206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.395816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.396094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.396364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.397049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:12.397351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.397632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537e37-f0f2-47c5-89d0-39125fd96d15 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.399467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.412341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 281/573] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:12.413230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.442462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.443317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.443826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.444135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.452329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.453871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:12.465993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.467033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 293/574] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.467957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.499070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.527050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fc2996-0c19-4246-8eb4-8359021526aa None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.558675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.563825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.564428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.564695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.565008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.565768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:12.566062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.567726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.571034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aad4f3-65dc-47ff-8aa1-c540f9e93b1f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.579808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 282/575] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:12.580635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.611390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.612022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.612304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.612575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.624125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.625625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:12.652593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.654090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:12.655739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:12.655739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:12.655739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:12.655739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 294/576] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.655739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.691933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afd3ce-4634-441a-9e62-5d2863a901fe None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.728107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.728769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.729049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.729318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.740949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:12.746306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.747429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 283/577] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.748356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.752597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.771834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f120-1e7e-4b95-82d5-1a040437dbf5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.802903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:12.806123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.806754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.807034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.807306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.813959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.815432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:12.827720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:12.828836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 295/578] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:12.834915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.854593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9369b672-a4ec-4c78-9018-399550fdddb1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.888607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.889239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.889515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.889785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.890470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:12.890774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.892192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.904732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 284/579] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:12.905536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:12.931995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b26dd-df02-4481-9fcf-83a3264d18d2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:12.969390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:12.970318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:12.970945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:12.971303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:12.982464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:12.984484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:12.998123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:12.999444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 296/580] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:13.000698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.004218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.015447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30be8b-54b5-4054-bcb7-980c0d0c8648 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.029357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.049756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.050504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.050780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.051046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.051683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.052138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.053771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.066156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 285/581] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:13.066945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.110506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00e128-1235-4a52-bf75-e08badff74f0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.146898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.147592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.147868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.148222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.148919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.149219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.150596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.158534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 297/582] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:13.160565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.168377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb76a-badf-41e0-847a-605c8aa12d73 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.202955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.203562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.203845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.204120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.204838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.205144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.206586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.219377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 286/583] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:13.220178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.230361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.253708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.270048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ec218-e074-4e2a-a997-069d14eb7c8a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.303998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.305263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.305667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.306089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/e7d037659771432197be501a15d207ee` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.321995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=0354722e40a344e9b2196bfa7b3e00e9, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.323449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.323561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6284b-4abc-4e69-90b6-6d4f90950007 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.357402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.358005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.358282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.358554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.359282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.359583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.361243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.378208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 298/584] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:13 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:13.379305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.387587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 287/585] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:13.389063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.507752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.514427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78de1-135e-48c1-af7e-5e8931e0ecf9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.519649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0eb12-6c14-40c0-a42d-1883e297c965 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.537170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.558898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.559661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.560079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.560417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.561286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.561992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.562336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.562680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.568870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.570933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.574720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.576127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:13.585569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:13.587121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:13.588329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:13.590182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 299/586] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:13.594813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:13.594975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:13.596296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:13.600164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:13.600164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:13.600164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:13.600164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 288/587] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:13.600164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.714965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee434a-f473-4af7-bd48-97bf20b2f727 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.715161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b509f-0e88-408b-b19e-2a765ad06613 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.753139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.754041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.754460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.754870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.755045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.755812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.756155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.756534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.757323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=3fb72c42601649fe866653918ccbb6fb) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.757715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.759111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.772558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 300/588] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/role_assignments?user.id=3fb72c42601649fe866653918ccbb6fb&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:13.772558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.780195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.783048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:13.786069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:13.807871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:13.809581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:13.815776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:13.815776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:13.815776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:13.815776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 289/589] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:13.815776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:13.828912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:13.934737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b146c8a-1e3f-4cb1-a656-2965670177aa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.959478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b0e89-5225-42bb-b7e7-58e0a9ae67dd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:13.980245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:13.981083 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:13.981361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:13.981633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:13.982283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:13.982824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:13.984620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.002260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 301/590] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.003191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.011365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.012348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.012964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.013496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.015126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:14.015693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.017780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.052495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 290/591] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.053439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.117750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.122888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8da1f0-e511-4bb4-977e-dacdbd7cab4e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.124518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.168701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.169496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.169875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.170242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.170992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:14.171394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.172957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.177103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417a0e0-238a-4382-a6bb-b0c34c7454df None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.190169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 302/592] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.191224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.222494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.223134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.223405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.223767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.231980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.233397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:14.248102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:14.250818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 291/593] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:14.252668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.308344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012c420-ef9f-4630-95ea-98f8e0a045c2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.345091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.346190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.346537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.346972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.360954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.362780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.366439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b73c8c-d60f-4b14-be4e-3f440b6bec7f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:14.381003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:14.383119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:14.385229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:14.385229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:14.385229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:14.385229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 303/594] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:14.385229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.398247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.401108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.432485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.433211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.433500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.433777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.443150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.445970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:14.462141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:14.463069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:14.463984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:14.468650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 292/595] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:14.469554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.509635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc2377-e51e-4c74-a98f-e0bdf4bd8c37 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.547149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.548149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.548663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.549136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.550178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:14.550659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.552352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.575788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 304/596] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.577040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.600939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633197b-d564-4d97-aa5d-83e5ed247fb2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.638997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.639985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.640469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.641030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.642010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:14.642608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.644149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.663008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.664730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 293/597] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.665936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.705615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.712913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04236cb8-2f9e-4b36-bac4-7c51c1a3d779 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.761204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.762934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.763048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.763238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.764142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:14.764449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.768420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.784873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 305/598] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:14.786055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.793646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e624e6-19a3-4032-a229-2dd584bffbd8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.837495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.838542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.839016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.839490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.853313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.855511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:14.875806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:14.876812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:14.877713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:14.877713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:14.877713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:14.880184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 294/599] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:14.881320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:14.918921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51342d5b-9279-487b-bc33-17a6d9f2232f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:14.955978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.966529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:14.967418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:14.967877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:14.975699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:14.977681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:14.979876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:14.989923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:14.996060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:15.001545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 306/600] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:15.002409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.011416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6660fc-0149-4559-ab64-bd53a13e5e1f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.058961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.059623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.059895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.061044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/ae76bbd0c6b34ed996bc76c1f4a00e27/roles/e7d037659771432197be501a15d207ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.081763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=ae76bbd0c6b34ed996bc76c1f4a00e27, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.084436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.127736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02963b1-39b3-496e-86c3-1396f542d9a5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.140891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 295/601] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:14 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/ae76bbd0c6b34ed996bc76c1f4a00e27/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:15.140891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.218694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.219317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.219776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.220248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.221490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:15.223804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.225278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.251726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 307/602] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:15.258225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.361338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fca376-6101-4538-b422-005543f97d08 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.375803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:15.405775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.406395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.406679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.406951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.407656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:15.407961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.409799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0b10-7b85-48d5-88ee-a74f2ee1243f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.411664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:15.423172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 296/603] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:15.428784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce3e3-2269-46a2-99e2-1a6d9c2d32b4 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.428784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce3e3-2269-46a2-99e2-1a6d9c2d32b4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.428784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ce3e3-2269-46a2-99e2-1a6d9c2d32b4 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.428784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 297/604] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:15.430373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce3e3-2269-46a2-99e2-1a6d9c2d32b4 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.456411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016366e5-5100-4e92-a9f8-8b525ac6605d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.499422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.500445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.500994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.501709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.511058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.513596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6184208b-5ae7-4e25-9b08-66c5af3a9d63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:15.533579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:15.534690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:15.535744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 308/605] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:15.536743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.537019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.537292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.559838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ce3e3-2269-46a2-99e2-1a6d9c2d32b4 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.560706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:15.562299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:15.603450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.604902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.605385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.605878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4bb596b4e1074e5d85dec4ed71dc3052/roles/e7d037659771432197be501a15d207ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.625061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=4bb596b4e1074e5d85dec4ed71dc3052, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.627362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.650212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 309/606] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:15.651516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.694005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:15.715844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 298/607] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:15 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4bb596b4e1074e5d85dec4ed71dc3052/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:15.765818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d2d0c-be0d-460d-bbec-9a509b2de332 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:15.813154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:15.813782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.814062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.814335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.815120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:15.815487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:15.817118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d595-fb74-44b9-95ab-2ed24744fe6f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:15.831524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 310/608] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:15.842130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:15.876883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb33d6-a34a-45ed-8a6e-1d4975d2a7f6 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.877215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb33d6-a34a-45ed-8a6e-1d4975d2a7f6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.877589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb33d6-a34a-45ed-8a6e-1d4975d2a7f6 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.878997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 311/609] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:15.885440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:15.885738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:15.886089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:15.916387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:15.921895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:15.923453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:15.987831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6b986-9fff-4f5a-b824-31924743bfc3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.025705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 312/610] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:16.034788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.035455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.035729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.036051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/aff851a161644ee0b97c18d2c30dc5a7/roles/e7d037659771432197be501a15d207ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.055382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=aff851a161644ee0b97c18d2c30dc5a7, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:16.056866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:16.090099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.123672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:16.136031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 299/611] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:15 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/aff851a161644ee0b97c18d2c30dc5a7/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:16.208324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7abb4a-39ff-4eb5-9fb6-b7535af2027a None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.250729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.251736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.252221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.252796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.265836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:16.271388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:16.272366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:16.273940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:16.280818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 313/612] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:16.283897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.328288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.435394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e00bb-0ece-421e-9332-e24e41493001 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.449188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:16.453933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:16.467871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c36ae-9371-4030-9e5b-a1bb85bc2bdd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.494124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.494751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.495029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.495298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.495980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:16.498737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:16.498737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:16.505589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.506198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.506479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.506753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.518838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:16.519021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 300/613] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:16.529144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:16.534032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:16.534873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:16.535527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.535603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 314/614] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:16.541824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.656824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeaec22-ed3c-4b8f-8564-546344245ab3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.696219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.696531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.696828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.697241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.697923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:16.698331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:16.700145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:16.710158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 315/615] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:16.721133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.738469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:16.786864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c5ce2-0737-452b-b2a2-d024089f5b4c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.832111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e38a1c5-926f-4ece-a20e-26341a16d79e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:16.870744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.871531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.871821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.872165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.885966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:16.887580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:16.903969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:16.905174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:16.906074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:16.906074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:16.906074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:16.906074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 316/616] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:16.913081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:16.922803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:16.923537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:16.923883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:16.924164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:16.948819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:16.953358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:16.983932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:16.984984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:16.987079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:16.987079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:16.987079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:16.987079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 301/617] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 456 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:17.000316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.022795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.041068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.069494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f966b-be31-4b62-a270-971aaa98165d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.109238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.109867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.110151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.110422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.111274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:17.111585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.113806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.130132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 317/618] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:17.138888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.259623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03d70c-f662-4d4e-a1ee-710b5f8feb3e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.296097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.296752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.297041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.297316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.297963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:17.298268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.299651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.313461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 302/619] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:17.318675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.391929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0a365-7d19-4db4-bb8c-95cadd6ad83b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.431618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.447786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.471895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.472860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.472860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.473136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] PATH_INFO: `/v3/users/swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.490752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.493434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.502816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b8e3-4d81-49ef-b206-a6502d36cf97 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:17.521839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:17.523601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:17.524897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 318/620] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:17.541717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.551164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.551895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.552218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.552495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.561037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.562686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:17.576434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:17.578430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:17.580586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 303/621] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:17.583893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.705733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcc898-6491-454f-899f-19ed1d98a9cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.730835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d74e4-fc2f-4361-9aac-068c24660194 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.761224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.765636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.766374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.766994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.767767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.769091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:17.773571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.773571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335cda6-9344-4695-a373-d0d3077189f3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.773878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.773878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.773878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.773878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.775394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:17.776014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:17.777745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:17.796949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 319/622] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:17.798272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838672b6-9297-43ba-a2c0-87725b511b45 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.798558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838672b6-9297-43ba-a2c0-87725b511b45 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.798831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838672b6-9297-43ba-a2c0-87725b511b45 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.799434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 304/623] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:17.800171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 320/624] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:17.805801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.806534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.806822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.807096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:17.830106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:17.831656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:17.869645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:17.906422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 321/625] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:17.907846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:17.950590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcf26a-ec9a-49dd-a1ba-fa84f7995dc4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:17.996561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:17.997631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:17.998109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:17.998573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.009822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.011578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:18.027758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:18.028731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:18.029651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:18.029651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:18.029651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:18.031714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 305/626] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:18.045699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.047333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff9eaf-c836-49e7-bceb-8b8c4ef097b2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.095264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.096760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.099257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.099737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.111301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.177614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.214202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.215783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6385acc-65c0-48c8-adca-b8372039a845 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.216256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fdbe1-095f-4619-b673-264df44434ca None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.266695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.267705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.268651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.269203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.270481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:18.271267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.278188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0ecc9-0230-48a3-8171-3098840e2b2b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.298656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 306/627] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:18.298656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadd3aa-faf1-440a-ac8d-ea140d80ce8e None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.298656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadd3aa-faf1-440a-ac8d-ea140d80ce8e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.298656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadd3aa-faf1-440a-ac8d-ea140d80ce8e None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.300755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 307/628] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:18.301339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadd3aa-faf1-440a-ac8d-ea140d80ce8e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.389214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 322/629] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:18.389214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.389214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.389214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.425666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:18.426912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:18.504165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.510127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.520549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadd3aa-faf1-440a-ac8d-ea140d80ce8e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.520778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 323/630] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:18.520778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.566630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.567349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.567729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.568687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.579203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.580668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:18.602244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:18.603710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:18.604593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:18.611129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 308/631] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:18.611129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.652897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37834ab-8c3a-4e8f-b967-cb52abfee81f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.690063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.690793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.690974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.691224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.706726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:18.713014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:18.713948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:18.714782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:18.718414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 324/632] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:18.719470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.757922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f766e-f79e-4f0c-92e5-7244cc116e54 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.784066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.795498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.796131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.796568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.796882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.807591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.809118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:18.823778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:18.824825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:18.825730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:18.825730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:18.825730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:18.828189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2cd8a-58b8-49e0-b3c1-bad6d09bdc18 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.829295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 309/633] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:18.830067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.841979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:18.863404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.864012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.864292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.864566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.865281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:18.865581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.867678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731de45f-8a2a-445a-80da-001f6aabd8a2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.879149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 325/634] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:18.880324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7edc7d-ac86-4b54-8609-9d767821b38e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.880610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7edc7d-ac86-4b54-8609-9d767821b38e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.880909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7edc7d-ac86-4b54-8609-9d767821b38e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.882341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 326/635] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:18.882919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7edc7d-ac86-4b54-8609-9d767821b38e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:18.934978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0ee5f-71c7-4fb9-970c-da0d3bb7e21f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:18.985406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:18.986159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:18.986527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:18.986934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:18.987698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:18.988125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:18.989796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:18.998268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7edc7d-ac86-4b54-8609-9d767821b38e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.007957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 310/636] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:19.007957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.022386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.038290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.039583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.039947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.040303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.052100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:19.060767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:19.062380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:19.063794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 327/637] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:19.065680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.094263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.133829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ee77-1259-4a71-b6e3-8df3cc29dd8e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.188724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.189646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.190065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.190516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.191601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:19.192121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.194574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fe338-bc51-4382-9bea-563df2f4a323 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.207368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fca1e-b9b5-4a51-baff-7d644d46644e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.219547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 311/638] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:19.219547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.219547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.219547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.245531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:19.247438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:19.260767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.261532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.261929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.262390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/3fb72c42601649fe866653918ccbb6fb/roles/e7d037659771432197be501a15d207ee` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.280276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=3fb72c42601649fe866653918ccbb6fb, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.282881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.327345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 312/639] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:19.328867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.365586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 328/640] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:19 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/3fb72c42601649fe866653918ccbb6fb/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:19.367924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.433561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.473124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.550137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc884b-9159-45da-b48b-ad657e157986 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.551720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80e9cb-acd3-4ea2-abc4-e883b5f5c35a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.596019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.596478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.596749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.597039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.597919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:19.598224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.599636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.609111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 329/641] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:19.611871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.624878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.626320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.626989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.627637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.646683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.649685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:19.677053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:19.678882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:19.681902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:19.681902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:19.681902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:19.681902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 313/642] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:19.681902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.756695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.769665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd8fa-7ab5-40da-8f7a-94d2507bc39f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.826364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.827641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.827931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.828208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.836118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388e398-7483-4e96-a5d6-cd52ddc120f5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:19.841938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.841938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.852598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:19.867408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:19.869423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:19.870532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:19.871451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 330/643] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:19.872302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.881869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:19.883614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:19.884298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:19.885088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:19.897675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:19.899728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:19.916875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:19.918474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:19.920251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:19.920251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:19.920251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:19.922892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 314/644] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:19.923769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:19.993934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4504e-6830-48f3-9732-5a3a5775a62f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.041999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.042923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.043341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.043780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.044916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.045382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.047840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.076475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 331/645] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.077959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.078099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f191b2-d81f-412f-8fcb-d51baa3b0c9f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.104118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.134641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.135543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.136002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.136460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.153511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:20.162839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:20.164605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:20.165473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 315/646] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:20.166634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.205819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.236465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c30c9f-20b8-48e5-9036-f8fac5c9d385 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.275385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.276308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.276625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.277403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.277612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.277914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.279352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.289022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247efdd-2a46-46d9-8dd1-32bb933fddba None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.296313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 332/647] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.296313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.333613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.334231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.334512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.334784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.335489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.335913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.337564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.355645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 316/648] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.355645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.390108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.421591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17ef6-d366-455e-8163-aa900e74a957 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.456436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.466026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.466845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.467261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.467666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] PATH_INFO: `/v3/users/glance` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.472627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886dfc-a75e-415e-b91b-ade86f77fac7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.476203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.477772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:20.490076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:20.491020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 14:36:20.492144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:20.493929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 333/649] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:20.494721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.514015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.514838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.515275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.515687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.516496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.516978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.518337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.531966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 317/650] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.531966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.607790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d403b8-8802-44b2-8ff3-51fecb57efbf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.637072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.640581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddedbe9-5ef6-469b-a3be-b038eeda5f6e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.642119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.646855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.652682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 334/651] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.653518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.696737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.697996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.698422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.699108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.713246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.716264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:20.736383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:20.737640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:36:20.738781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:20.743281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 318/652] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:20.745097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.758350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:20.791727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945ba955-5277-4a0b-baba-2534d8e3350b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.830133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.831002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.831529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.831941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.832887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:20.833340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.834936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.855410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 335/653] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:20.856656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.868779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b64e-d143-4e5a-b07b-3de5c36e0275 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:20.912063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:20.912625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:20.913032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:20.913304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:20.926360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:20.927827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:20.943252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:20.945801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:20.947442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:20.947442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:20.947442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:20.947442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 319/654] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:20.947442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:20.953356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.011009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df940bbf-40da-46a5-b2cd-b51df3957e72 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.025888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.050562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.051167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.051440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.051703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.052431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:21.052749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.054432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.080293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 336/655] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:21.080293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.087302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ef146-8303-42ad-8576-e6f7bffb62d8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.136494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.137378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.137817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.138247 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.192199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec65a54-8836-496b-98a9-ef8e14d2ef70 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.207641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.230841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.231757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.232467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.232895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.233149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.233399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.234196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:21.234591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.236422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.256753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 337/656] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:21.258482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.320769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.384011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 320/657] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:21.385146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.398957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccfae3-2fb2-411d-95cf-6e0fc62d448f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.435190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.435960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.436332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.436697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.481542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.495644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8bd0-8ff0-4f11-a113-ba6f1cf24a19 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.510673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.512280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcdf8-0e5e-4b81-9a92-15798288417d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.532222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.533200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.533640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.534066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.541730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.543427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:21.556098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:21.557207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 14:36:21.558529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:21.560939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 321/658] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:21.562003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.599685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.630217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 338/659] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:21.631704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5b69-c6cc-4fe3-9d78-fa8c8fa9c047 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.631988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5b69-c6cc-4fe3-9d78-fa8c8fa9c047 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.632310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa5b69-c6cc-4fe3-9d78-fa8c8fa9c047 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.635059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 339/660] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:21.635486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa5b69-c6cc-4fe3-9d78-fa8c8fa9c047 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.679688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde06f6-7aa2-4342-b06e-c4d9a5ef5780 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.722944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.736398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.736398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.736398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.736398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.747165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.748538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.761708 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa5b69-c6cc-4fe3-9d78-fa8c8fa9c047 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:21.763938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:21.765597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:21.767168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:21.767168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:21.767168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:21.769640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 322/661] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:21.770467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.816669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.817319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.817594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.817860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.818595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:21.818896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.820949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a19abb-6fcf-41da-ac01-26f758a7bfe2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:21.841139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 340/662] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:21.842394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.842678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.842948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.857279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:21.868812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:21.870751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:21.906665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c82c4c-d530-4608-b11e-2024a1168f4e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:21.955651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:21.956305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:21.956701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:21.956934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:21.970626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:21.971349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 341/663] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:21.972230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:21.983449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:22.008406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:22.009450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:22.010866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:22.010866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:22.010866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:22.010866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 323/664] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:22.010866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.058927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.123210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30feb595-b7ec-485d-b631-754395ad97d5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.152232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39bef6-1aea-4d8b-bd03-42e3550c13be None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.163155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.163946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.164223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.164493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.165310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:22.165800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.167144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.184784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.185079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 342/665] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:22.185880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.205927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.207299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.208186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.208917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.303630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d9be4-81db-47f8-854c-09b6fbbab7bb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.305030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.306495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.326787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.343004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.343677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.343954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.344224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.345052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:22.345357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.347038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.366317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 343/666] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:22.367740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.421651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 324/667] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:22.422609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.450032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.486592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968761f-5a81-4bbc-b91a-dc7ea21a714d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.528600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.529256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.529534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.529803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.530042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eecc-925e-4541-a3db-a688475ae15e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.537411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.539410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:22.551235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:22.552188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 344/668] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:22.553865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.573288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.573928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.574217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.574640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.586936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:22.591667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:22.592790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:22.597113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:22.601004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 325/669] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:22.603647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.607518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.701156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda21f-7a26-45cc-b6ae-42be8f915a91 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.704265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.720660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f24e8f-e6a4-44f8-bb5d-61e165239da1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.738623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.739270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.739544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.739808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.746877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.749037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.763785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.764422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.764701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.765036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:22.768569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:22.769586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:22.770478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:22.775019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 345/670] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:22.776038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.777270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.778812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:22.796009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:22.802220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:22.803326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:22.803326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:22.803326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:22.803326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 326/671] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:22.803326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.881748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.885532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426680aa-0bb1-4bc7-b9d4-7fdfb591c4f5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.919965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94beff0b-92ae-4383-8078-ebc57f642530 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:22.924443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.925080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.925354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.925620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.926309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:22.926608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.928036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.940379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 346/672] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:22.941201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:22.958396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:22.959004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:22.959281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:22.959552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:22.960219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:22.961659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:22.963170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:22.965542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:22.972615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 327/673] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:22.979275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.046050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e421-c689-4811-8273-2bf3aa3360db None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.080126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.080751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.080875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94076a84-55e5-4948-9a0d-89f59db160ef None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.081042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.081291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.081980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.082281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.083716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1d268-2c5b-4d3a-af73-d3408ac1a62d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.096344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 347/674] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:23.097686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29152b3f-80c3-46ad-82f0-e7fb1eef3b33 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.097967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29152b3f-80c3-46ad-82f0-e7fb1eef3b33 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.098236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29152b3f-80c3-46ad-82f0-e7fb1eef3b33 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.099582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 348/675] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:23.100177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29152b3f-80c3-46ad-82f0-e7fb1eef3b33 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.118371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.118974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.119245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.119510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.120149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.120442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.121997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.123644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.139309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 328/676] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:23.139309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.193232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.206999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29152b3f-80c3-46ad-82f0-e7fb1eef3b33 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.236079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694ef14-7ad9-44ab-a3b9-dc96fff67f8b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.241153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.241795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.242069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.242332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.243056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=ae76bbd0c6b34ed996bc76c1f4a00e27) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.243359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.244811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84218303-87c2-4b65-87e9-7fd5c8aeb232 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.251090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 349/677] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/role_assignments?user.id=ae76bbd0c6b34ed996bc76c1f4a00e27&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:23.252247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.252528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.252824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.272414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:23.272628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.273786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.274068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.274337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.274447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:23.293789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.295273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:23.320572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:23.321652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:23.322567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:23.322567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:23.322567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:23.322567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 329/678] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:23.322567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.377735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 350/679] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:23.379116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.403002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.459897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2b3ad-1315-4e5d-ab52-bbcaf7745ad4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.474840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.503828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.504442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.504763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.505079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.505820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4bb596b4e1074e5d85dec4ed71dc3052) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.506504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.508972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.517276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 330/680] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/role_assignments?user.id=4bb596b4e1074e5d85dec4ed71dc3052&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:23.518164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.518783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8af98f-6292-4b10-893d-01b1bad680ab None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.571802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.572527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.573327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.573607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.583619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.586503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:23.603620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:23.606449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:23.607357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 351/681] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:23.610773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.651034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de78794-e844-4d3c-b3d2-46d1eabebcc3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.713476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.714092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.714428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.714696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.715402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.715700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.717131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.728874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.732584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 331/682] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:23.733960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.759235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77796cf9-28ad-43b1-8402-08286f089e51 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.780221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.803496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.803496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.803496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.803845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.805024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:23.805341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.806785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:23.827764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 352/683] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:23.828761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.868802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7c493-b826-4d18-b28f-358d0c8dc33c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.906478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.907499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.907988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.908455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.919840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:23.924947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:23.926303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:23.927170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:23.930769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 332/684] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:23.931829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:23.940801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a351c76-9c96-43b9-b383-968ba218975a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:23.981144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:23.982132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:23.982607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:23.983057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:23.985322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:23.993996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:23.995465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:24.011675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:24.012685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:24.013680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 353/685] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:24.014286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.050160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.058916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7763b7-5761-43f6-9c2a-3f9f0f0e6c33 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.100080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.101840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.102128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.102397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.103196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=aff851a161644ee0b97c18d2c30dc5a7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:24.103501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.105776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.113807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 333/686] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:23 2022] GET /identity/v3/role_assignments?user.id=aff851a161644ee0b97c18d2c30dc5a7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:24.115015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.167402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fca6d-1ef0-4f33-8f4c-e572cea2fe52 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.238703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.239894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.241867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.243269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.244228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:24.245512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.247157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.265383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 354/687] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:24.274169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.307079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab6c79-3c07-48a7-b9cf-b08cc72ce5b1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.352457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.353505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.353824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.354100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.356136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:24.356454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.357942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.391129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.396349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 334/688] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:24.403857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.425830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.456254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c312eb-d6dd-4681-b3d0-48e9697daf84 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.503354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.503997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.504275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.504546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.515835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.517355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.530227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c457b8b-5ca3-44ff-bec5-60e55ddc4412 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:24.532746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:24.533653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:24.534557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:24.534557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:24.534557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:24.539336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 355/689] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:24.540584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.576098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.576733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.577073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.579421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.717532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8f31-621d-4cc6-8911-e3bbbc6b60d1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:24.723329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.724837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.753059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.769075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:24.801979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:24.803495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:24.803774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:24.804100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:24.804928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:24.805232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:24.806618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:24.845720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 356/690] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:24.850060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:24.959543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 335/691] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:24.961458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.062884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff71d0-6a92-4500-93a8-6dabf46b6605 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.135130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.135773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.136047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.136303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.149742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.151203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.165973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc8644a-c51a-465b-a91b-92d7f1acbb8c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:25.174182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:25.175235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:25.176177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 357/692] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:25.193712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.194330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.209467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.210019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.210834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.211121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.230719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.232248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.254117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:25.259754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:25.260705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:25.261636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:25.261636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:25.261636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:25.266458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 336/693] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:25.273412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.356518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff4d5a-63f6-4a9e-bbc9-b961c289612a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.400249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.400893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.401225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.401650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.402512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:25.402872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.404537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.429509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 358/694] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:25.431587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.495073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391c01b-fed6-4144-9d68-45afb3e96c32 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.567152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.567769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.569236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.569236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.569236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:25.570264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.571273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.606313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 337/695] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:25.612014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.622239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.647564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85216-7635-4c9f-8454-b74d723e6b54 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.666635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.686340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.686944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.687223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.687491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.769771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.771371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507965a-429c-4b00-8c00-adf2273be968 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.776816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165c153-8b83-471e-a7cf-52ea20cbe0c6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:25.833135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:25.834079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.834833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.835817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.846926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:25.849573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5e81ad96-ae69-4c98-8ec6-2ccb5bf3c860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:25.870680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:25.871862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:25.872775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:25.876406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 338/696] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:25.877694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:25.877807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582a3-e423-474a-9c91-3f062d6fbfd7 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.878018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582a3-e423-474a-9c91-3f062d6fbfd7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.878296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f582a3-e423-474a-9c91-3f062d6fbfd7 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.884202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 339/697] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:25.885492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f582a3-e423-474a-9c91-3f062d6fbfd7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:25.900912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 359/698] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 14:36:25.902492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:25.902967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:25.903459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:25.925010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:25.926488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:25.988394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.008739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 360/699] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:26.008739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.013408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f582a3-e423-474a-9c91-3f062d6fbfd7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.058101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.058718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.058998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.059266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.060225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:26.060532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.062865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cec8ab-e085-4010-ae8e-b14b4da99829 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.084999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 340/700] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:26.087593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2257e8-b7af-49b9-b9fa-284cb63d138f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.088160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2257e8-b7af-49b9-b9fa-284cb63d138f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.088444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2257e8-b7af-49b9-b9fa-284cb63d138f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.091800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 341/701] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:26.092546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2257e8-b7af-49b9-b9fa-284cb63d138f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.130523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1850054-679f-4ecf-999d-6f4fab275669 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.153728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.174565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.175252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.175527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.175794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.187128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.188641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-ea8e8954-53df-4abf-b0b8-7ad555e81e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:26.206012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:26.207053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:26.207983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:26.207983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:26.207983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:26.207983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 361/702] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:26.208745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.212461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.212461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.228014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2257e8-b7af-49b9-b9fa-284cb63d138f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.230388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:26.231682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:26.273046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.273861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.274143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.274413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.275144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=3fb72c42601649fe866653918ccbb6fb) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:26.275451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.277462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.288935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 342/703] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/role_assignments?user.id=3fb72c42601649fe866653918ccbb6fb&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:26.289809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.323230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.336795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 362/704] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:26.336795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.496636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf4850-5d47-46be-a7bf-0a3456adcd25 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.499576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.503463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddb6ec-e5f6-4211-bc46-916de4655dbb None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.541440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563053-b57e-4a70-b659-df777caef316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.542372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563053-b57e-4a70-b659-df777caef316 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.542685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563053-b57e-4a70-b659-df777caef316 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.542955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563053-b57e-4a70-b659-df777caef316 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.543643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69563053-b57e-4a70-b659-df777caef316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:26.543913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69563053-b57e-4a70-b659-df777caef316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.545346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69563053-b57e-4a70-b659-df777caef316 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.547310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.548245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.548739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.549221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.559504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 343/705] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:26.560778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf1d0-effc-4a5d-b049-8852cce2e925 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.561068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf1d0-effc-4a5d-b049-8852cce2e925 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.561342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bf1d0-effc-4a5d-b049-8852cce2e925 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.562849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.562961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 344/706] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:26.564647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.566124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bf1d0-effc-4a5d-b049-8852cce2e925 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-9e42386f-94de-4d6e-93ba-24b2effa2664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:26.581214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:26.582212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:26.583712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:26.583712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:26.583712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:26.583712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 363/707] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:26.583712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.584740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.585019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.609928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:26.611138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:26.664107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.695042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bf1d0-effc-4a5d-b049-8852cce2e925 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.696020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 364/708] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:26.697077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.752534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.753321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.753599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.753870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.763854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.765652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:26.782716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:26.783680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:26.784596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 345/709] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:26.785142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.806570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.830328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472722ad-42ed-4361-8a7e-8fd8c040c89c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.869972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.870985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.871483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.871920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.872736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:26.873188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.874843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.893782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 365/710] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:26.895150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:26.920491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ba788-2be3-4d36-8bc6-7432887b7a7d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:26.965245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:26.968887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:26.969530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:26.969808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:26.970078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:26.970668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:26.972578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:26.987159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:26.988276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:26.989613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:26.992869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 346/711] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:26.993941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.019483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf2aa39-1265-497e-95e3-e360445a065b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.059229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.059841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.060140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.060387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.061112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.061413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.062901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.072802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:27.080784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 366/712] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:27.080784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.110101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19829ce-4bd3-4bdb-912a-a8396ae54512 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.147426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.148916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.149302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.149675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.150418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.151964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.185416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39872016-a8d7-4ec8-8113-5650410ddf27 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.220219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.220855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.221397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.221664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.222289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.222585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.223951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.229296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 367/713] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:27.230091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.232628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 347/714] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:36:26 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:27.233775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.316701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:27.323658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:27.371954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca2b3-3af4-45ec-b2fc-a45ec25f9c83 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.391859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e75a0-e37f-41d5-aba5-11dfa2cf8e40 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.420157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.421145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.421648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.422107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] PATH_INFO: `/v3/services/network` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.422878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.424262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.436038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.436583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.436914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.437190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:27.437686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:27.438633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:27.439468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:27.440195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.440195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.440195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.443732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 368/715] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:27.446415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.447104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 348/716] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:27.447792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.595011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70851-ce75-4c22-90b8-13aa769a6f14 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.595750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9a042-5675-4851-9d22-2d27e6834157 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.620891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:27.643130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:27.646029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.646989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.647425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.648407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.649591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.650196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] RBAC: Adding query filter params (name=network) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.650376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.651231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.651725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.651916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.652372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.653259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.653766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.655399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f56f5-c6dc-4c6f-91e8-3b22a03868f5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.657950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 349/717] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:27.661791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 369/718] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:27.664191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:27.784967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70fc999-0e63-4417-949c-089a34805640 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:27.823613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:27.824570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:27.825057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:27.825515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:27.826341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:27.826849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:27.828425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a0d505-0594-4303-b735-5343aa1293e1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:27.835946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 350/719] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:28.541364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71cb08-4b59-419f-bfe6-bf2909feb3ab None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:28.541908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71cb08-4b59-419f-bfe6-bf2909feb3ab None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:28.541908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71cb08-4b59-419f-bfe6-bf2909feb3ab None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:28.543238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 370/720] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:28.548934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:28.549772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:28.550253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:28.578432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:28.579967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:28.631237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:28.661673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 351/721] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:29.043937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71cb08-4b59-419f-bfe6-bf2909feb3ab None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:29.182371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71cb08-4b59-419f-bfe6-bf2909feb3ab None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:29.230011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:29.230659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.230939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.231210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.247832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:29.252985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:29.253927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:29.254778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 371/722] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:29.260374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:29.458377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8777eb8f-8f46-410d-9b68-cdba152a2efa None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:29.511342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:29.511968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.512243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.512513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.513219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:29.513519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:29.514897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:29.528799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 352/723] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:29.534304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:29.605039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:29.667522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139f2de-6641-42f5-bc16-408db82fe04d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:29.719555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:29.720207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.720486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.720775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.737733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:29.739210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-329fe158-b7f8-4132-a9de-82b1e397c2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:29.758720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:29.759850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:29.760802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:29.760802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:29.760802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:29.760802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 372/724] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:29.765899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:29.809820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:29.848388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113b278-5ba4-4b7a-bf2c-acf2da9f83e9 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.848754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113b278-5ba4-4b7a-bf2c-acf2da9f83e9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.848962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113b278-5ba4-4b7a-bf2c-acf2da9f83e9 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.850283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 373/725] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:29.860201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed0dba-510b-4c55-bb10-f5907f835f29 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.860472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed0dba-510b-4c55-bb10-f5907f835f29 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.860830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed0dba-510b-4c55-bb10-f5907f835f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.886749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d5ed0dba-510b-4c55-bb10-f5907f835f29 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:29.888069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d5ed0dba-510b-4c55-bb10-f5907f835f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:29.919738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2833466-3b06-4784-b6a1-0b528a602df1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:29.957821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:29.958526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.958806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.959072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.959811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:29.960138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:29.961621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:29.964383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 374/726] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:29.965723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ab27-4f6f-4d3f-81db-289b47034a0c None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.966012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ab27-4f6f-4d3f-81db-289b47034a0c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.966285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63ab27-4f6f-4d3f-81db-289b47034a0c None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.967853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 375/727] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:29.977223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:29.977536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:29.977875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:29.980209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 353/728] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:29.985829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.017801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:30.019442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:30.083394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.105572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.111806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa201d-6069-457f-b644-be1f7bb2bf62 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.148916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.149547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.149820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.150089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.157815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:30.159278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:30.170868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:30.171941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:30.172956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 354/729] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:30.179326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 376/730] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 14:36:30.182695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.244460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.367421 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8ffb8-6f03-434b-8c0e-93f948cdea53 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.402355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef535fc-d3d3-4019-890c-d5ea5cdd4205 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.439261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.440465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.441013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.441496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.441635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.442111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.442394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.442670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.443407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:30.443713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:30.445280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2332-a1fb-4241-8ecb-e70c6cc6675a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:30.465574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:30.467702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 355/731] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:30.469378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5c90-c5c5-496d-90f8-eb7181c7e118 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.469844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5c90-c5c5-496d-90f8-eb7181c7e118 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.470310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c5c90-c5c5-496d-90f8-eb7181c7e118 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:30.470474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:30.471864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:30.472945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:30.475178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 377/733] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:30.476372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.479601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 356/733] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:30.481874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5c90-c5c5-496d-90f8-eb7181c7e118 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.500463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.510888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.591019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c5c90-c5c5-496d-90f8-eb7181c7e118 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.600564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351dc3e-3dce-4d4f-b3f1-1a6a5c42f56c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.629902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.630513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.630788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.631114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.631771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:30.633083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:30.636674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:30.639292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.639905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.640190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.640456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.643535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 357/734] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:30.644535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.725042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:30.727080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b4c83-9b99-49d8-845e-9f412e818c56 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:30.745509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.752659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.771034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67ea8a-0ab0-444c-b533-25313ba9e377 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.808414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.809309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.809592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.809864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.826927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:30.836836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 378/735] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 14:36:30.836836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.836836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.836836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:30.837209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:30.838066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:30.838999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:30.840633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 358/736] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:30.841223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.857377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:30.858568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:30.926357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 379/737] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:30.927200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:30.943949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e48a-9556-4b10-9722-e87d5637bb60 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:30.982689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:30.983242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:30.983518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:30.983786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:30.987471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:30.997712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.001026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.002871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:31.015947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:31.021889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:31.023741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:31.023741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.023741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:31.023741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 359/738] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:31.023741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.057197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27b665-22b1-4a72-93b2-e5619560328e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.093187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.093907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.094259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.094594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.105435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.106980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3d0e5c96-0d16-4d91-a2a0-348b336d1fad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:31.122423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:31.123574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:31.124444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:31.124444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.124444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:31.124444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 380/739] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:31.125058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e5c7b-d9e8-4460-8499-8872c09313c8 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.125339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e5c7b-d9e8-4460-8499-8872c09313c8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.125607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e5c7b-d9e8-4460-8499-8872c09313c8 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.130849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 381/740] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:31.130849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e5c7b-d9e8-4460-8499-8872c09313c8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.139330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f083a8d-b025-4234-bdec-2341372a10b9 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.175623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.176232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.176515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.176815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.177485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:31.177785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.179760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.188258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 360/741] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:31.189092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.240059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e5c7b-d9e8-4460-8499-8872c09313c8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.241977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.248200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.275738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.276341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.276614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.276911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.277558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:31.277861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.279214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88540b-4e6d-477c-a30e-bdf8f5e92e55 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.290555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 382/742] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:31.291750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.292030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.292300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.300245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787b44c-8156-489b-99b0-77b325e1b99d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.310535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:31.311732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:31.334928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.335912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.335912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.336169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.336847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:31.337148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.338516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.351048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 361/743] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:31.351811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.383604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 383/744] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 14:36:31.384451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.461970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00fa11-4d28-4f36-a92e-977459ddf369 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.474183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.501243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.501792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.502069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.502344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.504322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.510715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f713c3-49c2-457b-851a-04a93ceabecf None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.514524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.515982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:31.531227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:31.538109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:31.539746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:31.539746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:31.539746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:31.539746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 362/745] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:31.539746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.553463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.554804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.555176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.555537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.556165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.558161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.643594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097029c6-67ee-439f-af73-bfd189332c62 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.660900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 384/746] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:36:31 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:31.660900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.715250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.715892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.716168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.716435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.725256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.727718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:31.741130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:31.742863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:31.743816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:31.744345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 363/747] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:31.745037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.766131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.774894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d6909-c2ee-4642-aec2-d705b048426a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.814390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.815029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.815310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.815586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.824422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.825993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:31.840702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:31.841660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:31.842594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 385/748] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:31.843717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.864159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27ce05-9ff1-4234-acf9-da9fe49d9f96 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:31.864776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:31.904491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:31.905156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:31.905432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:31.905753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:31.906427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:31.906729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:31.908099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:31.924758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 364/749] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:31.924758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:31.965375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b43b83-5d3f-45c7-b5df-70eceab567ee None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.001799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.002510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.002788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.003052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.003761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.005182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.008208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.030832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c74f5-5600-4e28-aeee-70cc2707a211 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.057444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 386/750] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:36:31 2022] POST /identity/v3/services => generated 240 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:32.058288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.086422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.087796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.088315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.089318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.090398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:32.090940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.093551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.124768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 365/751] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:32.124768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.188061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.220515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec84800-d996-47ec-9eef-d45c3a6e4586 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.260934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d3855-1c7d-48f7-9102-40f9affa710a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.269380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.270196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.271025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.271305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.272326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:32.272706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.274700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.293016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 387/752] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:32.293813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.303958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.316932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.317982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.318462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.320128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.331089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.333818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:32.351194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:32.352199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:32.353179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:32.356016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 366/753] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:32.357186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.431200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84ee0c-8fd7-4324-a088-2444586be265 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.470871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.472095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.472574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.473197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.478064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.481629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7e51b-4d1a-47ae-8cea-64c6d1b99bd3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.519981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.520599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.520926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.521202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.521939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=3fb72c42601649fe866653918ccbb6fb) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:32.522240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.524576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.532759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 367/754] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/role_assignments?user.id=3fb72c42601649fe866653918ccbb6fb&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:32.532759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.578062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.579610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.605313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.792104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 388/755] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:32.797892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.802532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34017e4f-52c5-4841-9a2c-99d0aa0be858 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:32.848378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:32.849044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:32.849322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:32.849591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:32.850324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:32.850713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:32.852914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:32.861088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:32.885103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 368/756] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:32.893061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:32.980536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82df0a-654a-48c6-90e2-4cc6112e3b9d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.037424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc3d70-95b5-4c68-b219-eed2caca8c29 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.052990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:33.058438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.059140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.059413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.059677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.077559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.079021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.081431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.082070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.082344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.082921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.104325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.105958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:33.111571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:33.113804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:33.115874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:33.115874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:33.115874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:33.115874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 389/757] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:33.126264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:33.129871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:33.130801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:33.131674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:33.131674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:33.131674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:33.131674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 369/758] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:33.137028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.300541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:33.305483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a29066-bc98-464c-88fd-186b2af58517 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.328417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d37de-81a8-4bcd-b6b6-4be85fe53f6f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.378598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.379106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.379430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.379748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.380602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:33.380602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.382013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.403866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 370/759] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:33.407682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.409282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.409730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.410778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.411060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.414222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:33.414548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.415956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.436939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 390/760] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:33.442494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.468196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:33.605988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c5a1f-7e67-40bf-891b-0e3af0767659 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.640390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426dc9bc-17d8-4945-b3cc-dc4fd0365090 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.686465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.687500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.687980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.688450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.701512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.704930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.721549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.722542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.723020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.723522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5b522043-f00f-43ff-8f11-20dfde80f238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:33.728618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:33.729517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:33.730397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:33.738105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 371/761] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:33.738105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4061da-55d9-4373-90a6-1a62fc3b29a9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.738105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4061da-55d9-4373-90a6-1a62fc3b29a9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.738105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4061da-55d9-4373-90a6-1a62fc3b29a9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.741245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 372/762] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:33.742100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4061da-55d9-4373-90a6-1a62fc3b29a9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.743828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.745536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1c34e5d4-6c48-4c74-ac0b-02fc1d773545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:33.758062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:33.758978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:33.759855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:33.762215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 391/763] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:33.767941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.768530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.769022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.787735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:33.789386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:33.793011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:33.846019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:33.868998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4061da-55d9-4373-90a6-1a62fc3b29a9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:33.871182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 392/764] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:33.880771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:33.945175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:33.947287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:33.952368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:33.952841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:33.953705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:33.954163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:33.955922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:33.982833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 373/765] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:33.986757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.091825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09619219-df27-4ae3-a756-3b25fb23b285 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.156737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.157770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.157770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.157966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.158619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:34.158926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.160367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.170820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e679a39-260d-4e86-a616-9c2ed2953f7c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.175236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 393/766] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:34.176381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.201169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:34.207124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.207850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.208159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.208475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.210664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=0354722e40a344e9b2196bfa7b3e00e9, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.212164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.292818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7af2f-223f-45fd-b495-b87071f8ff1f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.293485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 374/767] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:33 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:36:34.295584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.321210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:34.362389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.363038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.363309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.363576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.364165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.365833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-49a159cc-e877-4026-a3fc-156c7dd72f15 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:34.375694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:34.376788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:34.378076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 394/768] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 14:36:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:34.378875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0ded-4ab2-4535-ba51-54bb13d539bc None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.378875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0ded-4ab2-4535-ba51-54bb13d539bc None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.379007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a0ded-4ab2-4535-ba51-54bb13d539bc None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.384692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 395/769] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:34.386473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.386676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.386828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.407743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:34.409112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:34.452151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def5ce1-0621-4588-a0cd-fb4cd75404ba None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.487262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:34.499489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.500126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.500403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.500669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.501428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4f381185bbee4e77aaeec0379d1b8a56) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:34.501743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.502431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 396/770] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:34.503186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.503363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.514343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 375/771] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:34 2022] GET /identity/v3/role_assignments?user.id=4f381185bbee4e77aaeec0379d1b8a56&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:34.624552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fa759a-8c6b-41a5-94b8-8dd2b197e3d7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.699475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.700496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.701015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.701454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.702557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:34.702990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.706238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.718594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 397/772] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:34.727541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.812338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:34.828101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:34.877552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0d5f-4fd1-492f-ab29-407993e3c309 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.915285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:34.945787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:34.946430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.946524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.946759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.947401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:34.947703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:34.949121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ad306-a2f8-4f20-9eb3-518806727d1b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:34.956991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 376/773] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:34.958202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65a25-52e2-4a03-afed-c32754409f9b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.958483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65a25-52e2-4a03-afed-c32754409f9b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.958752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e65a25-52e2-4a03-afed-c32754409f9b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.960848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 377/774] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:34.966502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:34.966781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:34.967051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:34.987891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:34.988756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1cb2-f7db-4f1d-b630-fb6ae2b3cf0e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:34.989724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:35.027212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.027845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.028129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.028377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] PATH_INFO: `/v3/services/network` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.029003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.030665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:35.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:35.041547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:35.042413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:35.047067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 398/775] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:34 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:35.048012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.074345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 378/776] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:35.075542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.146656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:35.189170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa34df6-1fee-4a7c-9b25-81199d72894e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.230774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.232170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.232849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.233364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.234219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] RBAC: Adding query filter params (name=network) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:35.234731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.236368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.243642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 379/777] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:35.252916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.268039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fd3c9-065a-407f-99ac-f8d6fad66b5f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.308957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:35.337504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.338292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.338681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.339024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.340447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] RBAC: Adding query filter params (interface=public, service_id=616f8da3095448b3a94f1335dace456a, region_id=RegionOne) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:35.340574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.342145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.360372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 399/778] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/endpoints?service_id=616f8da3095448b3a94f1335dace456a&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:35.365418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.371150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f79-24b7-4fae-9dd8-63d6740569cd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.403393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:35.411755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.412741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.413335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.414483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.415312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:35.415903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.417588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.423516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 380/779] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:35.435662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.519782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfa0b4-6888-4375-89d5-da8821c718d3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.557793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.558410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.558692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.558962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.559685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.561265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.567541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 400/780] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:35.568378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.572424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6033494-f299-48b5-9e0c-c845f1ee33b6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.653703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:35.660089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.660743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.661032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.661471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.662782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] RBAC: Adding query filter params (interface=public, service_id=e418e958d7df4771ba7aa0aed83fe01b, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:35.663141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.669443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.686731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 381/781] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/endpoints?service_id=e418e958d7df4771ba7aa0aed83fe01b&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:35.697508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.772107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4090672-63cd-4b4c-a257-2d86712b6ef0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.800865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:35.815331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.815980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.816263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.816534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.832104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:35.839259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:35.840392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:35.841504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:35.844023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 401/782] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:35.849695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:35.859075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d85853-a218-47d1-9e24-2ad8c1e6e8d2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:35.906463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:35.907381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:35.913798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:35.914281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:35.915082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:35.921718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:35.935867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 382/783] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/services => generated 772 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:36.099685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8341ee62-5bf0-4788-9c7d-db6ad64128d2 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:36.110949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:36.138821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:36.139440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.139716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.139990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.140657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:36.140992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:36.142369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:36.151462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 402/784] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:36.158146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:36.279770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d63b9-848f-438d-966e-37bfbe66e925 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:36.304563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:36.321016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:36.322094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.322094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.322264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.333406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:36.335496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:36.353044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:36.354027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:36.355169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:36.355169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:36.355169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:36.355169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 383/785] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:36.365856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:36.493819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdbacd-93e7-4dd5-84f9-bcc5703f386c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:36.529376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:36.529989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.530266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.530531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.531175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:36.531473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:36.532881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211de5d9-a889-4766-9c84-29438f8c27cb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:36.546620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 403/786] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:36.554980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:36.753215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f2dfb-90e4-4f46-ad4d-28db5f6a597c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:36.792688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:36.793358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.793637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.793913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.806176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:36.807652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:36.820299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e146bd-372f-45c1-b4ae-c544ec8b58ac None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.820918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e146bd-372f-45c1-b4ae-c544ec8b58ac None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:36.821158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:36.822183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:36.823133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 384/787] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:36.824297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e146bd-372f-45c1-b4ae-c544ec8b58ac None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.827844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 404/788] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:36.829224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:36.831608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:36.832161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:36.833093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:36.861147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:36.862750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:36.892832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:36.895617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:36.971943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 405/789] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:37.003336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19337cc4-5116-4d63-9cbf-4c5c18f26316 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.050639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.051538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.051968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.052389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.053296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:37.054650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:37.056445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c2e9-e56e-4531-9b93-7d1f7494f6b2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:37.081664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 385/790] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:37.087671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.115408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f839-5204-4966-bd1e-bf0e38051cbc None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.115934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f839-5204-4966-bd1e-bf0e38051cbc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.116982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2f839-5204-4966-bd1e-bf0e38051cbc None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.118708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 386/791] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:37.124294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.124791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.125207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.151178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:37.152604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:37.232967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72271e-ddd1-4bdf-b9bd-8dcb2876d2ff None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.242316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 387/792] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:37.291730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.292629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.293072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.293486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.308418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:37.309928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:37.328118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:37.329135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:37.330040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:37.330040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:37.330040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:37.330040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 406/793] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:37.335600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.370029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:37.401851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.418498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:37.516403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0bafe5-cd05-4756-959a-bd23427de612 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.577029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.577986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.578450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.578912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.579978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:37.580470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:37.582896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:37.589361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c794-f47d-4926-aa6a-6fcc664753d4 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.603334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 388/794] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:37.604279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.638453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.639095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.639379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.639647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.652559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:37.657313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:37.658252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 407/795] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:37.659547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.694993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:37.717259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8e950-75bf-4f46-84a8-ecf42e29c08d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.756470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:37.766561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.767212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.769727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.769727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.782797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:37.789043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:37.790005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 389/796] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:37.791436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.795308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124bdf28-3fda-46c6-afe1-8de7210a0be1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.833152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.834592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.835190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.835839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.843608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:37.845600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:37.858870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:37.859801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:37.860757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:37.863542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 408/797] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:37.864857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.911450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da094a7f-e001-457c-8bc4-738bf39e9bdc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:37.947825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:37.948447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:37.948734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:37.949028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:37.949709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:37.950100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:37.951402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:37.966194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 390/798] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:37.966194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:37.967595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:37.997467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f4429-5f3c-490a-8303-571463a26e94 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.033291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.040800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.041813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.042298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.042726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.043557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:38.049611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.049611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.056895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 409/799] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:38.058473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.073347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3d1d6-5ad5-4cb2-b6c1-f0090f680ebd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.110558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.110919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.111197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.111466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.112177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:38.112474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.113929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.126959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 391/800] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:38.127822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.179891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b11340-c840-44f0-b5ab-880c60dbf17c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.198612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.220073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.221381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.221856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.222130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.233613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.235092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.241194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17040d38-6763-4cbf-a7b6-8cd4f7e1e271 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:38.251685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:38.252738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:38.253650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:38.253650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:38.253650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:38.253650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 410/801] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:38.253650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.290835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.292094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.292382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.298751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.311114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.311542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.313037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-05efe8ca-0eb8-4e01-8f10-0e9c378f1b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:38.332997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:38.334081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:38.335114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:38.335114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:38.335114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:38.335114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 392/802] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:38.336666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbda5f-694a-490c-90b9-5ac7907044e9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.336666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbda5f-694a-490c-90b9-5ac7907044e9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.336666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbda5f-694a-490c-90b9-5ac7907044e9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.342496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 393/803] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:38.342496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbda5f-694a-490c-90b9-5ac7907044e9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.386635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d99fc0-8971-499f-b24a-b85d83a6d3a4 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.422025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.422679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.422954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.423221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/3fb72c42601649fe866653918ccbb6fb/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.425295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=3fb72c42601649fe866653918ccbb6fb, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.426755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c651d3-5e82-4126-877b-edaf6e4defcd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.450134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbda5f-694a-490c-90b9-5ac7907044e9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.464182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.485073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.485654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.485928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.486193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.486835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:38.487133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.488505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe78c6-ba30-47d7-939d-fe709f738302 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.489836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 411/804] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:38 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/3fb72c42601649fe866653918ccbb6fb/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:38.491899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d62a-c88c-4214-9cb3-b610573b726c None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.492321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d62a-c88c-4214-9cb3-b610573b726c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.492599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573d62a-c88c-4214-9cb3-b610573b726c None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.493931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 412/805] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:38.494765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573d62a-c88c-4214-9cb3-b610573b726c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.505079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 394/806] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:38.506653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75f424-9ffc-4069-b476-824f0ece5715 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.507099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75f424-9ffc-4069-b476-824f0ece5715 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.507513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b75f424-9ffc-4069-b476-824f0ece5715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.529541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6b75f424-9ffc-4069-b476-824f0ece5715 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:38.530769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6b75f424-9ffc-4069-b476-824f0ece5715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:38.613418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 395/807] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:38.615059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.615508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.616928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.639358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573d62a-c88c-4214-9cb3-b610573b726c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.642863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:38.645513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:38.650018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.681209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.682100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.682856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.683894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.684740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:38.685189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.686796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.704802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 413/808] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:38.704802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.744906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 396/809] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:38.746050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.801181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:38.849459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5170b-12ff-48de-bf5b-cf42145648a6 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.885366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.886344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.886764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.887208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:38.895208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:38.898179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:38.916027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:38.917232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:38.918362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:38.920987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 397/810] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:38.927038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:38.940914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145840ea-f28c-477f-b168-afb5c946511f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:38.988609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:38.989286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:38.989564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:38.989833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.003702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.006253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:39.026436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:39.027689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:36:39.028784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.031514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 414/811] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:39.032641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.061417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.068638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d468bcf-bd96-4fed-afa0-dee1f22bfe24 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.082870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.110968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.111924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.112159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.112426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.113202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.113503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.114938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.134601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 398/812] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:36:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.135444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.172273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec68a2-d5c5-4aa1-971f-3b1101923c3c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.211466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.212258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.212651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.213039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.213720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.215231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:39.225884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:39.227006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 14:36:39.227915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.232030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 415/813] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:39.232930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.254525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade8a7b-6ee7-4a3d-9b1c-07518b79f0ff None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.291490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.292219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.292347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.292684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.293363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.293668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.295090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.319815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 399/814] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.321029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.331780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.334015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.342352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b742456-f5ae-499c-975d-07cef171e876 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.386213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.386930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.387278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.387707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] PATH_INFO: `/v3/services/network` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.388374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.389878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:39.400068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:39.401340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 14:36:39.402404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:39.403847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 416/815] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:39.404519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.431584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32887eb5-dfcb-48ee-baaa-f87a64ff1ada None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.468270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.469029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.469373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.469722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.482339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.483866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:39.498485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:39.499671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:39.505414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:39.505414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:39.505414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:39.505414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 400/816] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:39.505414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.526714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1880a3-7f20-4330-9e7e-682c7bef8f98 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.564943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.565552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.566172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.566283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.567022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.567654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.567957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.569565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.574945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 417/817] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.575749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.599777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.616924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691a35a-edeb-4311-a61d-7334141f22f5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.653636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.654389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.654762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.655131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.691401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4416bf-592e-4b83-9ee9-dc61127c4610 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.730040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.731529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.733097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.733752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.734032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.734344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.734979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] RBAC: Adding query filter params (name=network) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.735278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.736629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.746495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 418/818] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.746495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.799452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.837508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:39.843592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 401/819] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:39.843592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.861192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d8ecf0-145e-483d-9e89-61c0cbfe2d4a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.899235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.899898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.900676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.901720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.902376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.903362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.904882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.918584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 419/820] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.919519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:39.950151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376e1c6-908b-4690-bf5d-9d64453c6028 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:39.987113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:39.987811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:39.988012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:39.988282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:39.988937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:39.989242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:39.990593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:39.996009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 402/821] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:39.996829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.027599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.036980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd55252-41ff-4bd0-b0af-959198411d32 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.087997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.088617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.088926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.089197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.089872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] RBAC: Adding query filter params (type=network) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:40.092502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.093953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.104179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 420/822] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:40.104179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.115100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.119580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32427ae-8933-40a3-ab76-dd289707cd6a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.159566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.160201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.160484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.160787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.171362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.172859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:40.188754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:40.189793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:40.190701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:40.190701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:40.190701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:40.190701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 403/823] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:40.190701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.223048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee943b21-d966-45f8-9179-8721dcde65e9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.258398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.259034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.259310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.259577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.266641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.268187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.278172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:40.279798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:40.280663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:40.281604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 421/824] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:40.282084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.306345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44b28-e6d3-41d6-af7f-92a9ab79da98 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.343172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.343784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.344060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.344329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.345049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.346686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.352898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.395692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b86bf-4c6e-4b71-800d-706c032b6c8b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.439048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.439669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.439957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.440232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.440956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.442342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.465492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 404/825] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:36:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:40.471695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.568818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 422/826] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:36:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:40.568818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.604386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0610d3f0-dcf3-4ccb-8610-358cbcb2fb2f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.644992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.661522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.662310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.662587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.662855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.664232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:40.664535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.666042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b13c98-b603-4e46-86fd-d79243ece9e0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.682366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 405/827] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:40.684030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796470a7-4622-482f-a609-e4653c59c707 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.684267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796470a7-4622-482f-a609-e4653c59c707 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.684538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796470a7-4622-482f-a609-e4653c59c707 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.688884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 406/828] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:40.690093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796470a7-4622-482f-a609-e4653c59c707 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.731435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140fd3-1189-4ce5-8115-efa360327b39 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.776493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:40.793834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.794455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.794742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.795008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.795710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:40.796008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.798175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81923f-fdfc-4c05-8541-435aed0d363b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.818389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 423/829] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:40.821621 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.821892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.822110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.833794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796470a7-4622-482f-a609-e4653c59c707 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:40.847150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:40.848375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:40.874818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:40.875779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:40.876244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:40.877599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:40.886192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:40.888123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:40.901564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:40.902802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 407/830] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:40.903896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.940809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 424/831] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:40.940809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:40.975220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:41.042420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c7201-dfb5-4510-a0a8-ffb73eda986f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.047695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe75102-686f-4573-8b25-c2cbf7fbe2e0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.062629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:41.080077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.081147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.081869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.082551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4f381185bbee4e77aaeec0379d1b8a56/roles/e7d037659771432197be501a15d207ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.087707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.087872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.088035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.088306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.089037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:41.089337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.090841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.102669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=4f381185bbee4e77aaeec0379d1b8a56, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.108610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 425/832] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:41.108759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.109657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.228112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 408/833] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:40 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4f381185bbee4e77aaeec0379d1b8a56/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:41.228460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50db8d-04a0-4a0f-a17f-72dcab542a85 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.229502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.269898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.270676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.270961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.271280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.272035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:41.273263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.274873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.288762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 426/834] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:41.364178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:41.377843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0005f-c46a-4efd-a9fb-f647403bc0a2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.425692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.426352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.426631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.426900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.439059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:41.444856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:41.445963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:36:41.446914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:41.449938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 409/835] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:41.456083 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.497240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:41.568248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c004099-3aae-4ad1-a436-c3fc1c3d09d7 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.609888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.610503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.610781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.611052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.611716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:41.612018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.613433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.623415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 427/836] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:41.628605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.741890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfc5ca-e168-4eb0-ac64-a52236df158f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.778625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.779260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.779541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.779817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.791652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.793141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:41.807959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:41.808966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:41.809844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:41.809844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:41.809844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:41.809844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 410/837] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:41.817132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.917485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:41.921547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed702913-e8ce-4d95-bc65-f12a9a3d7f11 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:41.962301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:41.962910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:41.963185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:41.963455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:41.964093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:41.964396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:41.965810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:41.978774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 428/838] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:41.983997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:41.996147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:42.092606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea949062-c2f2-429a-a3cf-d6ee543660e7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:42.128918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:42.129552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.129833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.130109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] PATH_INFO: `/v3/users/swift` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.138783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:42.140230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:42.152555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:42.153522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:42.154471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 411/839] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:36:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:42.161796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:42.268093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f77486-c43e-4575-b717-847896a76b51 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:42.307831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:42.308440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.308737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.309008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.309742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:42.310050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:42.311544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850aee3-47b1-41e0-85fc-03c34a0096e6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:42.330660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 429/840] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 24 14:36:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:42.336206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:42.414804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:42.454634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5493e981-8020-497f-b797-0fd68171f1ed None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:42.492978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:42.494007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.494496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.494977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.533246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170bd8e-6baf-4615-bbcb-67ab2747d448 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.533550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170bd8e-6baf-4615-bbcb-67ab2747d448 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.533711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170bd8e-6baf-4615-bbcb-67ab2747d448 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.535889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 430/841] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:42.540363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.540645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.540951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.559813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:42.561062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:42.574844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:42.576635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:42.587202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:42.634486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 431/842] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:42.652456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:42.689700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 412/843] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:42.696546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:42.801822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5b3e3-9bcd-4d21-90e4-e234b7c599b8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:42.841952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:42.842593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:42.842866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:42.843133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:42.854134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:42.855743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:42.863507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:42.872092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:42.873125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:42.874033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:42.874033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:42.874033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:42.874033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 432/844] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:42.880313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:42.907700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:42.996976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d815ef-edf6-4628-94c2-f6f284d27cce None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.031830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fe5cd-eafd-4eca-8141-ca39c60c7b26 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.032986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.033598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.033970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.034156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.034791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:43.035092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.036473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.048759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 413/845] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:43.054440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.072978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.073772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.074048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.074315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.074952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.076340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:43.085615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:43.086647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:43.092372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 433/846] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:43.094955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.113573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:43.173445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce5cc5-764a-4a9f-b8f4-d004ad78e62d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.179891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:43.219567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.220809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.221902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.222333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.231169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa546c-46a1-4744-8e2e-74c14759a61e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.232239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.235131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:43.251053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:43.252176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:43.253306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:43.255954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 414/847] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:43.262018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.273102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.273749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.274028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.274297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.274939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:43.275243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.276623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.283705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 434/848] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:43.289897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.380579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:43.394370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37a746-de18-4552-ad56-e30aa88cae2b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.412540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65b93-e192-4e23-b7fa-628de56d633d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.433315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.433933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.434209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.434481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.435173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:43.435478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.436944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a7c56-c85f-4048-93e2-499cd163aeec None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.440045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:43.449192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 415/849] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:43.450489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba498f-3b19-4515-a533-033cfc6a9b22 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.456851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba498f-3b19-4515-a533-033cfc6a9b22 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.456973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.457110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba498f-3b19-4515-a533-033cfc6a9b22 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.457200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.457200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.457200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.457529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 416/850] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:43.457655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:43.457655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.457838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6c94-92ad-4f59-9847-93abf0fc978b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.457838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6c94-92ad-4f59-9847-93abf0fc978b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.457838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d6c94-92ad-4f59-9847-93abf0fc978b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.458030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0d8e-c176-4811-a265-07f9bae62ade None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.458098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 417/851] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:43.458098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6c94-92ad-4f59-9847-93abf0fc978b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.462391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 435/852] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:43.463600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d237-e4b0-4359-af4f-f625d19cf7ff None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.463880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d237-e4b0-4359-af4f-f625d19cf7ff None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.464145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00d237-e4b0-4359-af4f-f625d19cf7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.484954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-dd00d237-e4b0-4359-af4f-f625d19cf7ff None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:43.486966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dd00d237-e4b0-4359-af4f-f625d19cf7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:43.571279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 436/853] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:43.572603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.572921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.575809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.597918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:43.599611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:43.601064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d6c94-92ad-4f59-9847-93abf0fc978b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:43.650551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:43.651085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:43.651364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:43.651635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:43.652391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=3fb72c42601649fe866653918ccbb6fb) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:43.652703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:43.654550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:43.662013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 418/854] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/role_assignments?user.id=3fb72c42601649fe866653918ccbb6fb&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:43.691280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 437/855] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:43.874202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.890942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:43.986795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:43.987422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ff2d4-b78b-44b0-9c54-66008598c055 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.049357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.050760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.051313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.051752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.057819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:44.069375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:44.076214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:44.077529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:36:44.078563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:44.081213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 419/856] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:44.089791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.125791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ed7a5-076d-4b12-842c-419b95925c7c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.175464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.176540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.176922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.177264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.177934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.181756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.189138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:44.193412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:44.194972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:44.195852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:44.200478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 438/857] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 14:36:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:44.202684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.219895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066dbfc-514f-42e2-96b0-4754983dc0d3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.260839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.260839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.260839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.261277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.262264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:44.262721 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.264444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.275634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 420/858] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:44.281430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.330977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c3319-d74b-4be6-a55c-294004c44f97 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.347753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:44.374227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.374829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.375106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.375434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.376016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:44.376318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.377749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.393817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 439/859] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:44.395255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.433515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced01ad-e27c-4277-9f54-227e49d6cc90 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.485223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.486022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.486396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.486766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.489730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:44.505357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.507210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.517123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d778ff-2270-458b-af24-e2d65e86ce8b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:44.525210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:44.526375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:44.527461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:44.527461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:44.527461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:44.533817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 421/860] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:44.535189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.567405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.568136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.568419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.568690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.569815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:44.570152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.572588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.579016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 440/861] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:44.669039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2ab546-1492-4fff-aa82-abb7d34c2b95 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.714709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.715371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.715653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.715929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.716596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:44.716933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.718344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.739021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 422/862] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:44.740412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:44.792999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:44.869344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c1568-2bf4-4fa3-ac5f-3328793e1e68 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:44.908629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:44.909648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:44.910161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:44.910637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:44.920834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:44.922822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:44.936183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:44.937228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:44.938182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:44.940692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 441/863] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:44.947264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.006477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.064977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cea696-c36a-4838-8081-6b54b0f014e3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:45.103332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:45.103959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.104229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.104547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.105326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:45.105672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:45.107106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:45.130506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 423/864] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:45.132405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.250075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00323abd-d5b6-4f36-a555-6b9b1da133ce None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:45.252454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.292057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:45.293178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.293744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.294287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.380273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:45.387398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed60cc-2e8b-4529-beb6-e03439aeaf84 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:45.498970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 442/865] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:45.504724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.528028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe53e8-2b0d-4970-90a1-af0e9a7a96f2 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.528359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe53e8-2b0d-4970-90a1-af0e9a7a96f2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.528576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe53e8-2b0d-4970-90a1-af0e9a7a96f2 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.530328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 443/866] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:45.535905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56495de-ed38-4fc5-9e11-702ca63f16e9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.536059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56495de-ed38-4fc5-9e11-702ca63f16e9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.536325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56495de-ed38-4fc5-9e11-702ca63f16e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.543507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.555711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c56495de-ed38-4fc5-9e11-702ca63f16e9 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:45.556809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c56495de-ed38-4fc5-9e11-702ca63f16e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:45.619333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f98808-f1b8-45b3-9ce0-21f6f1efddf4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:45.622187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.637224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 444/867] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:45.659004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:45.659994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.660470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.660958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.672381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:45.674355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:45.674838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949b4f-a2e2-47e8-8760-dfaaef62c639 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.675129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949b4f-a2e2-47e8-8760-dfaaef62c639 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.675409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75949b4f-a2e2-47e8-8760-dfaaef62c639 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.676898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 445/868] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:45.683256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.683599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.683823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:45.691365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:45.692332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:45.693266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:45.693266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:45.693266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:45.693266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 424/869] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:45.702276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.708815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:45.710206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:45.784870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 446/870] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:45.813685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffabb83-19d2-4490-8cb4-2b11a8844985 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:45.849707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:45.850901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:45.851326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:45.852015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:45.852783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:45.853138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:45.854579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:45.868038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 425/871] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:45.873380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.930648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:45.939431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.950364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:45.981197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a975bb9-ab5e-4121-9fa6-7b1c9a956d17 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.020332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.020998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.021287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.021567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.029979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.031556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.040107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46485e7-5c99-4e01-95c0-dc0e28bf86cb None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:46.044115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:46.045219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:46.046365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:46.050341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 447/872] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:46.051303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:46.079337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.080089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.080447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.080811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.081523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.082950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.151302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 426/873] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:36:45 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:36:46.152145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:46.164801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84d7a-b9db-47f1-b5aa-54650e191d45 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.197904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:46.220409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.221756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.222314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.222754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.223835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:46.224465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.226417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.244346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 448/874] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:46.250195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:46.266508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:46.301978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93b88-87a8-4172-81d7-e2cad0d97ce5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.361574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.362208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.362491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.362771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.363359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.365454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:46.380166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:46.382177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:46.384048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 427/875] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:46.388275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:46.401750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ae78c-7ece-4516-9010-4ed7987cf412 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.438266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.439174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.439655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.440142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.441090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4f381185bbee4e77aaeec0379d1b8a56) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:46.441594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.443249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.450852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 449/876] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:46 2022] GET /identity/v3/role_assignments?user.id=4f381185bbee4e77aaeec0379d1b8a56&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:46.520081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d19c6f7-9385-472e-8c84-7d3c337f82d6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.567563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.568525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.569555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.570042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.583231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:46.583231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.583231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6af28a-f54c-4108-b1b2-e988ab847034 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.583231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 428/877] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:46.585489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:46.642840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:46.650482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6de2-0f4a-445a-9a6c-f9626a06b6d9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.650768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6de2-0f4a-445a-9a6c-f9626a06b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.651045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d6de2-0f4a-445a-9a6c-f9626a06b6d9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.652671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 429/878] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:46.658534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.658859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.659090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.669465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:46.682998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:46.684541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:46.718953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a4f5f-afda-4f92-a89f-2f8627ae8287 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:46.771541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:46.772888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:46.773176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:46.773444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:46.774092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:46.774399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:46.776433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0159b7-332b-40f4-becb-23529d3d1753 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:46.782591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 430/879] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:46.787332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 450/880] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:47.084390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:47.205915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a31d45f-f5ac-456a-8ae2-ee61a075a15a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:47.245542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:47.246158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:47.246434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:47.246705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:47.247350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:47.248738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac604018-7d79-4713-8ef4-53e635217e1e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:47.252314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:47.404847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 431/881] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:36:47 2022] POST /identity/v3/services => generated 269 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:48.310612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dffb5e-3e15-4494-bf2e-127885d7a4eb None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.311410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dffb5e-3e15-4494-bf2e-127885d7a4eb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.311410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dffb5e-3e15-4494-bf2e-127885d7a4eb None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.312498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 451/882] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:48.319197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc041a-209a-43e5-879e-b425d7589bfa None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.319699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc041a-209a-43e5-879e-b425d7589bfa None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.320174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc041a-209a-43e5-879e-b425d7589bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.343612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-95bc041a-209a-43e5-879e-b425d7589bfa None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:48.344866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-95bc041a-209a-43e5-879e-b425d7589bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:48.456848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 432/883] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:48.684104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498566-cd03-4acb-a421-c7932d50933e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.684439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498566-cd03-4acb-a421-c7932d50933e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.684845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0498566-cd03-4acb-a421-c7932d50933e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.686650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 452/884] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:48.695294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ca4d-5195-4cce-8a45-9d7c9e1329a0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.695693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ca4d-5195-4cce-8a45-9d7c9e1329a0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.696041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0ca4d-5195-4cce-8a45-9d7c9e1329a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.717149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-dbd0ca4d-5195-4cce-8a45-9d7c9e1329a0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:48.719231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dbd0ca4d-5195-4cce-8a45-9d7c9e1329a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:48.806446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0498566-cd03-4acb-a421-c7932d50933e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:48.809640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 433/885] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:48.898263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd8039-aa13-41ba-b51d-10e9df0a086a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.898720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd8039-aa13-41ba-b51d-10e9df0a086a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.899094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd8039-aa13-41ba-b51d-10e9df0a086a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.901765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 434/886] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:48.906792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:48.907068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:48.907335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:48.929883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:48.931121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:48.965343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0498566-cd03-4acb-a421-c7932d50933e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:48.975078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:48.987336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.018771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.020886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.021132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.021712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.023118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.024547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 435/887] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:49.024996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:49.038883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:49.041021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:49.043285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 453/888] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:49.048877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.158734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.170037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5b33dd-c85c-4b42-abd6-c3425ff17b0b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.206709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.207350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.207628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.207887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.208587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:49.208927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.211000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.216395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 436/889] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:49.222602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.272858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.286678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8f7ab-54cd-4925-a58d-ba19a0944d0f None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.324411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.325111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.325462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.325813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.338131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:49.340856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc646f-350b-488c-bebf-a0a723c41b46 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:49.343378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:49.344340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:49.345212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:49.350185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 454/890] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:49.351239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.386350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.387443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.387721 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.388143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.388888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:49.389302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.390628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.395995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 437/891] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:49.396585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.396915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.482043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3888c7-715b-4912-afe4-ccf2997a8f75 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.506915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e967706-ad4b-4de2-8fb2-fc025531de58 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.516986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.518032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.518642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.518921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.519192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.519833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.521236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.545840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.546474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.546749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.547013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.547671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:49.547968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.549358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.558618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 438/892] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:49.559445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.593607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 455/893] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:36:49 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:49.602179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.691017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2b039-725e-4e39-9218-58eb31709c70 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.738720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.739249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.739518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.739808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.740693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] RBAC: Adding query filter params (interface=public, service_id=935f9af038e143eea897ce632da213a4, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:49.740893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.741029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.742222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2af7-54b9-4712-8bfc-c582864da7e9 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.748202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 439/894] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/endpoints?service_id=935f9af038e143eea897ce632da213a4&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:49.749405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da753b-cda9-429f-bdd1-12d275f87635 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.749684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da753b-cda9-429f-bdd1-12d275f87635 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.749952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da753b-cda9-429f-bdd1-12d275f87635 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.754198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 440/895] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:49.754358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a6bf1-65e4-43be-a608-91b20d6bc298 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.754458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da753b-cda9-429f-bdd1-12d275f87635 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.791899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:49.801129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.801763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.802038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.802305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.815121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.816584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-81a5bb65-5e29-4835-8d82-c4d65c7296ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:49.833022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:49.834024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:49.834979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:49.834979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:49.834979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:49.834979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 456/896] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:49.835629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.835905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.836076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.857247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:49.858454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:49.875705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da753b-cda9-429f-bdd1-12d275f87635 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:49.919663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:49.920736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:49.921210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:49.921669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:49.922387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:49.923920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:49.930766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 441/897] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:36:49.931586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:49.939247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 457/898] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:50.055631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.064024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c29a52-59c6-4608-813b-710d78bd0b64 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.112154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.112842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.113125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.113395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.114046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:50.114348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.115749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.129895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 442/899] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:50.136473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.216524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.232460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.251497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bd725-2339-4b3b-851d-50528fccc63c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.293029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.293766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.294060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.294335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.302245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.304496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:50.321357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:50.322330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:50.323527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 458/900] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:50.328569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.350731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be1db6-ce44-492d-a018-77c6c09fca2e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.395730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.396528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.397994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.397994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.399054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.400865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:50.413791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:50.414862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:50.415789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 443/901] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:50.423080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.444665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.478425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb80fa-7e2f-4694-b37c-51d642d363a8 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.520366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.527895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.528766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.529192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.531789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.531789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:50.531789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.533500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.547414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184222a9-1b31-4600-8c2c-6c96b74012a2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.564841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 459/902] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:50.566697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.598201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.599258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.599678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.600070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.601816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:50.602227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.603716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.611716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 444/903] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:50.616912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.690900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe7f8f-5668-4063-bea1-582188125f27 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.717905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.729723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.730347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.731037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.731037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.744517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df2fac-3f61-4467-9192-0a51c50b391a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.791713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.792755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.793230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.793647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.794445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:50.794893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.795340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:50.797717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.803891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 445/904] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:50.812566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.814348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.815885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.939744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10e300-2cdf-4d16-8629-da619450030f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:50.964400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 460/905] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:36:50.969915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:50.987482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:50.988438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:50.989055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:50.989552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:50.990533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] RBAC: Adding query filter params (interface=public, service_id=8d780bbd805744b0847fb62d516ccea6, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:50.991610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:50.993462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:50.999732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 446/906] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/endpoints?service_id=8d780bbd805744b0847fb62d516ccea6&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:51.005953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:51.026645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:51.095988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:51.107994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94921f85-9214-4d4c-8ede-5c2197d614b3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.145258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8877f8-fd96-4d96-a469-b3ffd2044a74 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.150267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.150658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.150945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.151267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.164227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.165937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:51.182641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:51.183825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:51.184795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:51.184795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:51.184795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:51.184795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 461/907] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:51.189650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:51.195560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.195929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.196110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.196556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.197045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.198705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.210641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 447/908] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:36:51 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:36:51.317585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0c253-fbdc-46a2-9fb9-c6f7ea23ccfc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.356944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.357616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.357901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.358180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.358835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:51.359138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.360521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.377806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 462/909] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:51.383955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:51.476296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:51.516165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c492-aefb-4fdc-b213-7e0fd76df875 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.577782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.578817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.579303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.579851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.593342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.595937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e395c486-8428-4943-9621-ae639e8cf003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:51.618980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:51.619922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:51.620919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:51.621504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 448/910] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:51.627792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:51.630905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:51.685714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368e35-1354-4490-8f72-7c8e7a942496 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.686455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368e35-1354-4490-8f72-7c8e7a942496 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.686949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14368e35-1354-4490-8f72-7c8e7a942496 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.688878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 449/911] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:51.700257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.701152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.701642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.726115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:51.727991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:51.754239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2568977c-1eef-45c0-aca1-6ac67b299160 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.792331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.793322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.793824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.794288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.795164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:51.795670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.797456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.807971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 450/912] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:51.816523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 463/913] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:51.818096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:51.883152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:51.928200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918a619-c3d6-4521-b2b1-4828ff5c5e7a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:51.963971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:51.964566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:51.964918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:51.965198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:51.965925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] RBAC: Adding query filter params (role.id=e306d3a2741b44ebb2ee731408f97198, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4f381185bbee4e77aaeec0379d1b8a56) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:51.966232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:51.967656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d864c-ec53-4aab-b4e9-72b92982ebd8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:51.973855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 451/914] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:36:51 2022] GET /identity/v3/role_assignments?user.id=4f381185bbee4e77aaeec0379d1b8a56&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e306d3a2741b44ebb2ee731408f97198 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:52.098937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.099516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6dc3-6f97-4fa2-9efd-73ccd2123549 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.099810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6dc3-6f97-4fa2-9efd-73ccd2123549 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.100120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af6dc3-6f97-4fa2-9efd-73ccd2123549 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.102622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 452/915] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:52.107949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43918-3113-441a-b054-075c9c318adf None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.108240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43918-3113-441a-b054-075c9c318adf None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.108517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b43918-3113-441a-b054-075c9c318adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.129564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e2b43918-3113-441a-b054-075c9c318adf None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:52.130781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e2b43918-3113-441a-b054-075c9c318adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:52.174560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:52.222673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 453/916] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:52.223280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc406b-ed54-44d0-bd71-131ec6e81785 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.263093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.263772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.264045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.264360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.265008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.266381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:52.275502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:52.276738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:52.277829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 464/917] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:52.282768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43918-3113-441a-b054-075c9c318adf None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.347494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:52.397930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b43918-3113-441a-b054-075c9c318adf None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.437862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.438482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.438761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.439035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.439676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:52.439983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.441391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.448088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 454/918] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:52.453795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.514445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.584070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086a55b-61b7-43c8-8b55-ab65b3ecaf44 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.624179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:52.636735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0b3ea-fb41-4422-bd73-cdef859dae91 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.637056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.637677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.649051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.649051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.649051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:52.649051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.649051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.652812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 465/919] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:52.655721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.670229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:52.681613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.682248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.682527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.682819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.683385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.684770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:52.693696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:52.695937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 14:36:52.696815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:52.700614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 455/920] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:52.702195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.798285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626b440-bb34-47cc-894c-19b5d715650d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.835284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446a2ce-56df-495f-b886-c7205ad20f90 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:52.838398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.839258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.839772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.840262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] PATH_INFO: `/v3/endpoints` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.841244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] RBAC: Adding query filter params (interface=public, service_id=f38ca1af8aae482da45deef7b51fd706, region_id=RegionOne) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:52.841778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.843410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.854960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 466/921] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/endpoints?service_id=f38ca1af8aae482da45deef7b51fd706&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:52.856150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.876172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b774a-42de-4419-b612-00df97770f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:52.877241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b774a-42de-4419-b612-00df97770f8a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:52.877744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b774a-42de-4419-b612-00df97770f8a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:52.878229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b774a-42de-4419-b612-00df97770f8a None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:52.879108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b774a-42de-4419-b612-00df97770f8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:52.880017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b774a-42de-4419-b612-00df97770f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:52.883531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b774a-42de-4419-b612-00df97770f8a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:52.891158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 456/922] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:52.900567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b774a-42de-4419-b612-00df97770f8a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:52.935894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:52.962868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:53.002108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4330e72-fd82-4bc9-b4f4-0f106841bdab None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:53.019558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b774a-42de-4419-b612-00df97770f8a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:53.055909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:53.056919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.057413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.057902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.058702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:53.060696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577ad08-0fdb-44b5-bf50-5f6e58cb5285 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:53.063210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:53.063659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.063942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.064219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.064891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:53.065196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:53.066624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:53.076938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 467/923] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services => generated 1497 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:36:53.077144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 457/924] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 24 14:36:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:53.078151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:53.205352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bed74-ec95-429a-98c1-428a624e7768 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:53.222957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:53.247737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:53.248875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.249382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.249866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.251111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:53.254316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288edfb-9276-4daf-9519-4f158da5befc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:53.331412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 458/925] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:36:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:53.399809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d7da-efce-4dd9-b69c-a26e631961ea None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.400128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d7da-efce-4dd9-b69c-a26e631961ea None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.400360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585d7da-efce-4dd9-b69c-a26e631961ea None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.402098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 468/926] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:53.407871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.408386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.408386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.428165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:53.429715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:53.516543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 459/927] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:53.818038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d7da-efce-4dd9-b69c-a26e631961ea None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:53.931276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585d7da-efce-4dd9-b69c-a26e631961ea None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:53.949917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:53.968099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:53.968842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:53.969177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:53.969449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:53.970028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:53.971706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-00c92429-4520-40ef-9bfd-8396ad26e46d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:53.981890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:53.982970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:53.983905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 469/928] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 24 14:36:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:53.989903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.024585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2a05-ea3d-4916-8a60-d5652c24b1fe None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.025040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2a05-ea3d-4916-8a60-d5652c24b1fe None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.025329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f2a05-ea3d-4916-8a60-d5652c24b1fe None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.028799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 470/929] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:54.032171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.032443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.032728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.051391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:54.052579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:54.101693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:54.108627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdf961-d00e-48b1-9c86-26cfcf2bd635 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.133795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 471/930] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:54.150291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.150910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.151231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.151503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.152196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:54.152542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:54.154053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:54.160496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 460/931] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:54.166471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.281829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e322d98-a342-4c41-afc9-d395c5533142 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.296239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:54.319899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.320517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.320889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.321168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.321803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:54.322103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:54.323479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:54.329850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 472/932] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:54.335838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.415753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.460954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648366cb-a90a-4d06-9e46-03fe820bb6f0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.500545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.501241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.501525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.501790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.502450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:54.503854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:54.544410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0164f8a-63f2-4c6b-8191-25d51ef0f875 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.585512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.586155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.586434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.586699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.597591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:54.606600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:54.607624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:54.608525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 473/933] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:36:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:36:54.609820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.653310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 461/934] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:36:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:54.660864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:54.744225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79583272-bab9-49ba-9f59-4296653fbb35 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.792165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.792800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.793136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.793407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.794074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:54.794375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:54.796085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:54.806943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 474/935] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:36:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:54.812890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:54.837258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:54.936653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a909c-146a-4550-a6c7-05955a582177 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:54.982959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:54.983595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:54.983868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:54.984133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:54.999904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.001584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e029fd44-ff79-42c8-a314-6505cacd69db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:55.017995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:55.019022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:55.019942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:55.019942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:55.019942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:55.019942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 462/936] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:55.026102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.117521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a0d-3c54-480c-a9be-7f922dae1136 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.117857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a0d-3c54-480c-a9be-7f922dae1136 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.118065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb84a0d-3c54-480c-a9be-7f922dae1136 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.119691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 463/937] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:55.126527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.126838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.127084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.145709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.147756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:55.149215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:55.153356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7921-e6cd-4617-b82e-92f73512cf85 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.200928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.202453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.202960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.203450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.204773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:55.205699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.207621 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.229439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 475/938] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:55.230715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.233034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.239821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 464/939] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:55.350319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1df4408-7699-4e94-9aff-a335029157dd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.387702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.388335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.388607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.388899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.396381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.397913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-766970ba-08ec-4001-baba-cc204c0183a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:36:55.409729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:55.410699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:55.411643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 476/940] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:55.417089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.437618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d14d-1eb5-4303-81eb-63483d3b9b58 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.437890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d14d-1eb5-4303-81eb-63483d3b9b58 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.439928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544d14d-1eb5-4303-81eb-63483d3b9b58 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.439928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 477/941] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:55.448662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.448662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.448662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.467530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:55.468735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:55.482266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.543322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3978ad-1070-41a1-a854-cf62cec9feac None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.552885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 478/942] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:55.554549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.584033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.585407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.585407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.585407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.586456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:55.586770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.588796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.611916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 465/943] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:55.621731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.687723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419188f-c9b7-4b36-9f6d-3bcd00bf0589 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.700227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.740632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.742722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.743262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.743675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.744737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.746942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.751208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b2d98-38d7-41d3-aa13-d37dd97ced77 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:55.759501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:55.760841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:55.761849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:55.764978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 479/944] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:55.770485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.794768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:55.796356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.797285 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.797577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.798239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.815694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.817443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:36:55.838286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:55.839395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:36:55.840970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:36:55.840970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:36:55.840970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:55.840970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 466/945] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:55.846728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:55.940141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7201f3d-d610-4900-b913-f17bb3c0ab28 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:55.991693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:55.992458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:55.992914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:55.993315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:55.994243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:55.994898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:55.996587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.000644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a681-7a22-4f57-b879-8fee72e151c5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.003076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 480/946] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:56.003856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.016875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.052963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.053963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.054242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.054669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.055330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:56.055631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.057041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.074005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 467/947] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:36:56.074894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.092526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.130858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faee389-8706-4fa8-9d45-21bbe681cb54 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.171652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.173051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.173583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.174000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.174801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.176596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.179401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING keystone.server.flask.common [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 14:36:56.191142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343659-3384-4c27-b9a2-926d6477fd70 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.230012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.230801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.231107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.231565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.232256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:56.232547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.232908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.sql.core [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:36:56.232908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 14:36:56.232908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [parameters: {'id': '4713870c60d04be0875ab97b422e8010', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 14:36:56.232908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88269) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:36:56.233971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.244843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 468/948] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:56.244843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4713870c60d04be0875ab97b422e8010.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4713870c60d04be0875ab97b422e8010. Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:56.250930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 14:36:56.261583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application yield resource Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise self.value Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application session.commit() Aug 24 14:36:56.262578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:36:56.263483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:36:56.264390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:56.267069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [parameters: {'id': '4713870c60d04be0875ab97b422e8010', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.269603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:56.272012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4713870c60d04be0875ab97b422e8010. Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 481/949] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 24 14:36:56 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:56.277372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.301453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.406370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd6383-fd89-4437-9f2a-d66e64a3971d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.421479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c6242-3190-4922-9fbb-e65ca87f0d46 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.458831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.459493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.460529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.460896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.461165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.468613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.470426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.470426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.470426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.470426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.470995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.471128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.472657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:56.484944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:56.486485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:56.487359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:56.489119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 469/950] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:56.492223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.568775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 482/951] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:36:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:36:56.570074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.641802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.656263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe74c-0380-4004-b28a-c27da317d20f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.709185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.710987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.711320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.711764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.722364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.723979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:36:56.741813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:56.743028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:36:56.743984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:56.747951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ad1-3068-435f-80a3-5c618e1ed550 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.748515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 470/952] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:56.749565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.808489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.810536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.810536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.810536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.811276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:56.811765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.814092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:56.832174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 483/953] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:56.840553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:56.914455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:56.929364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ab257-d654-4d45-a581-7cdef288cb4c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:56.974447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:56.975756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:56.976147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:56.976420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:56.977136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:56.977444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:56.979161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890dff-4829-4b98-8c43-6ac81a27fe19 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:57.000763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 471/954] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:57.000965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99524-49ee-430d-bf1c-3fcfbb87022d None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:57.001186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99524-49ee-430d-bf1c-3fcfbb87022d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:57.001462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b99524-49ee-430d-bf1c-3fcfbb87022d None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:57.003028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 472/955] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:57.009462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:57.009742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:57.010011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:57.019639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9452f-84e0-42c5-b553-972331702ffa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:57.031234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:57.032566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:57.035147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:57.070129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:57.071339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:57.071806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:57.072291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4f381185bbee4e77aaeec0379d1b8a56/roles/e306d3a2741b44ebb2ee731408f97198` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:57.075196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=4f381185bbee4e77aaeec0379d1b8a56, role_id=e306d3a2741b44ebb2ee731408f97198)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:57.077110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:57.134813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 473/956] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:57.165874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 484/957] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:36:56 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/4f381185bbee4e77aaeec0379d1b8a56/roles/e306d3a2741b44ebb2ee731408f97198 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:36:57.447699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:57.565406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58ed05-2992-4cfe-a7ac-b97bd80df158 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:57.620044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:57.621111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:57.621615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:57.622091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:57.622883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:57.625154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:57.635853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:57.643216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:57.644106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 474/958] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:36:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:57.648674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:57.769339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294cb3-8b89-4f53-be5e-b4f62c547071 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:57.773043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:57.815107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:57.816189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:57.816697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:57.817288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:57.818212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:57.819651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:57.822304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad1090-25ee-49f9-b0d2-651541487823 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:57.832515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 485/959] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:57.842831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:57.845889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:57.961771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e78258c-2c75-4b75-9e1a-bd289ead1b43 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:58.001918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:58.002539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:58.002816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:58.003090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:58.003732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:58.004035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:58.005445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3f712-c0a7-4287-ab38-15501c6af929 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:58.012326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 475/960] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:36:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:58.900551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3fe8-6904-423a-9816-4d41bf720040 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:58.901128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3fe8-6904-423a-9816-4d41bf720040 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:58.901128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f3fe8-6904-423a-9816-4d41bf720040 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:58.902833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 486/961] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:58.908213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7eba-27a6-4f1c-af6c-330649b55d86 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:58.908628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7eba-27a6-4f1c-af6c-330649b55d86 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:58.908940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee7eba-27a6-4f1c-af6c-330649b55d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:58.935937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c4ee7eba-27a6-4f1c-af6c-330649b55d86 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:58.937189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c4ee7eba-27a6-4f1c-af6c-330649b55d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:59.016469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:59.026167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 476/962] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:36:59.236509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84fa80-9c08-410b-9db2-1dc74e30c503 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.236835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84fa80-9c08-410b-9db2-1dc74e30c503 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.237005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84fa80-9c08-410b-9db2-1dc74e30c503 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.238528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 487/963] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:36:59.244771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.245479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.246134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.267554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:59.269167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:59.288586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bdcd-8efc-4566-a52f-77daf354e603 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.289374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bdcd-8efc-4566-a52f-77daf354e603 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.289718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467bdcd-8efc-4566-a52f-77daf354e603 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.291392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 488/964] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:36:59.297987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.298304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.298527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.317389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:36:59.319644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:36:59.359786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 477/965] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:59.360779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.408402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 489/966] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:36:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:36:59.498285 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f51cc1-7f02-4dcc-823e-17d9daa469a4 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:59.530943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:59.540263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:59.545774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.545774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.545774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.545774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:59.545774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:59.552655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:59.554453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.555290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 478/967] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:36:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:59.563409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.648090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.676376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:36:59.680782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef18a4-a536-41da-a1a4-009b1ea3e59e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:59.724096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:59.724724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.725731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.725992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.726625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:36:59.726922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:59.728548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:59.734872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 490/968] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:36:59.735683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.801698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1039d8-742b-41a0-9421-740b9c51f77e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:59.861692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:59.862847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.863295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.863721 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.864819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:36:59.867584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:36:59.872042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING keystone.server.flask.common [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 14:36:59.876016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d76ba-302d-480d-af2a-64a84eccdf9a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:36:59.916807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:36:59.917538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:36:59.917714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:36:59.917988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:36:59.929515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:36:59.934183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.sql.core [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:36:59.934183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 14:36:59.934183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [parameters: {'user_id': '669012da8883451ab747c4dd3322a777', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 14:36:59.934183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88268) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:36:59.934876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:36:59.935786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:36:59.936635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:36:59.940498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 491/969] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:36:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:59.941449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:59.946143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:59.959844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application yield resource Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application next(self.gen) Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise self.value Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application session.commit() Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 14:36:59.960852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.session.flush() Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application compat.raise_( Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 14:36:59.961751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 14:36:59.962654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application conn.query(q) Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application result.read() Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 14:36:59.963531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [parameters: {'user_id': '669012da8883451ab747c4dd3322a777', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:36:59.964395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 14:36:59.965254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 479/970] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 24 14:36:59 2022] POST /identity/v3/users => generated 160 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:36:59.967164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:36:59.983352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.013374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.084077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6580a-9d2e-4c31-9b5c-78b8b421ad63 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.084302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1a9c-e973-42ad-8630-f5dff82a4196 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.119079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.119698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.120302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.120302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.120622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.120909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:00.121210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.121320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.121553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.121821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.122457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:00.122755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.122858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.124125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.130432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 492/971] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:36:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:00.131713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.146695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 480/972] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:36:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:00.148250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.238909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.254945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc74e-0eea-43c1-a915-21dd813e2d8d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.268175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4bdb7-c0b0-4802-85de-fc10465c3d83 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.285070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.291198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.291883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.292160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.292425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.300685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.302185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.312382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.313097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.313375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.313653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.314470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] RBAC: Adding query filter params (interface=admin, service_id=f38ca1af8aae482da45deef7b51fd706, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:00.314781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:37:00.315706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:00.316879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 14:37:00.318051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:00.319258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744939-1698-4367-b748-fd510d1927d2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.319333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 493/973] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:00.319333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.326397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 481/974] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/endpoints?service_id=f38ca1af8aae482da45deef7b51fd706&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:00.329650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbcf-b57c-4ae6-92ee-dffda69c2f25 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.329650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbcf-b57c-4ae6-92ee-dffda69c2f25 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.329650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169bbcf-b57c-4ae6-92ee-dffda69c2f25 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.330385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 482/975] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:00.333641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169bbcf-b57c-4ae6-92ee-dffda69c2f25 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.430360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531eed-b227-438b-8b11-069227cbd007 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.446311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169bbcf-b57c-4ae6-92ee-dffda69c2f25 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.467885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.468651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.468975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.469247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.481073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.482530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.484044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.484654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.484962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.485230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.486169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:00.486322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.487747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63ad6b-8cce-456e-9103-6f1145c6340f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.490579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:00.499379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:00.509264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:00.510377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:00.510377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:00.510377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:00.510377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 494/976] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:00.510377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.529687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 483/977] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:00.530932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.531221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.531490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.552647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:00.554566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:00.591713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.631535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16455599-45ff-43c0-8c0f-daca96c4cb9c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.648749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 484/978] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:00.648749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.695312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.696012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.696294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.696572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.697272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.698825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.705757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 495/979] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:37:00.780870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344ed0-fa48-4bbd-a9cb-2ffe7e39a1ed None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:00.829592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:00.830241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:00.830567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:00.830841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:00.831516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:00.831814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:00.833275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:00.847762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 485/980] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:00.854566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.932018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.940900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:00.972024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:00.975790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5b2e4-d445-4faa-8c56-19329ee26659 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:01.020696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:01.021502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:01.022492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:01.022774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:01.032674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:01.034211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:37:01.046504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:01.047517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:01.048474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 496/981] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:37:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:01.054374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:01.075103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af72e0-3e20-4f44-8ac4-ada20f897388 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:01.128202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:01.128873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:01.129156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:01.129606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:01.130633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:01.132915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:01.175229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb2cee8-b0f1-4b1b-bae4-404dd2a9f728 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:01.207699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:01.223851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 486/982] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:37:00 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:01.236960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:01.237858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:01.238264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:01.238671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:01.239839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:01.240294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:01.243347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:01.278724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 497/983] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 24 14:37:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:01.280360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:01.390584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:01.408380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b7ebd-1add-4f0b-bc76-50aff5f21a2e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:01.448307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:01.449301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:01.449728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:01.450157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:01.532907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:01.534576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:01.626765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:01.648637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 487/984] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:01 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:01.650039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:01.771015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bfc64-9301-4bfd-9484-f3fa01450a56 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:01.810323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:01.810882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:01.811163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:01.811437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:01.823674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:01.825248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:01.841295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:01.842388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:01.843444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:01.843444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:01.843444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:01.843444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 498/985] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:01.851043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:01.976916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871f52-56dc-4baf-81f9-c19c17afd2ba None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:02.018492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:02.019103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.019375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.019641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.020283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:02.020580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:02.022578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:02.035028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 488/986] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:02.041476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:02.073284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:02.154993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b61fed-0bbe-4439-b3c5-0aee7f3ef60c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:02.195415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:02.196058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.196335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.196602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.207847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:02.210323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:37:02.230342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:02.231538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:02.232872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 499/987] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:02.237479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:02.290143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:02.351480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319fa63-7faa-4ab1-bcbe-827d12ea9a49 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:02.391640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:02.392254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.392527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.392822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.393529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:02.393869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:02.395260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51580f79-d945-42e9-bff7-205f814f24b2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:02.414887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 489/988] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:02.416196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:02.521448 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:02.545850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b05f91-13d0-4480-929d-e5a53a8bd8a9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:02.585011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:02.585842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.586005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.586258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.586911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] RBAC: Adding query filter params (role.id=e306d3a2741b44ebb2ee731408f97198, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=4f381185bbee4e77aaeec0379d1b8a56) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:02.587416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:02.588851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947740-0b40-41c0-98fd-7e4f346a071a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:02.604857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 500/989] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:02 2022] GET /identity/v3/role_assignments?user.id=4f381185bbee4e77aaeec0379d1b8a56&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e306d3a2741b44ebb2ee731408f97198 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:02.748352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1a14-7e7b-4fee-9db0-8e830f7097d9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.748638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1a14-7e7b-4fee-9db0-8e830f7097d9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.748948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1a14-7e7b-4fee-9db0-8e830f7097d9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.750462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 490/990] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:02.756027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc548-d475-4f5a-aef8-a2c42d88b276 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:02.756368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc548-d475-4f5a-aef8-a2c42d88b276 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:02.756623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc548-d475-4f5a-aef8-a2c42d88b276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:02.778771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-057fc548-d475-4f5a-aef8-a2c42d88b276 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:02.779982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-057fc548-d475-4f5a-aef8-a2c42d88b276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:02.858731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 501/991] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:03.132685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e1a14-7e7b-4fee-9db0-8e830f7097d9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:03.256682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e1a14-7e7b-4fee-9db0-8e830f7097d9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:03.266067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:03.307524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:03.307953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.308229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.308497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.309111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3504-9c4c-4484-901c-ec649e75dddf None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.310164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:03.310240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3504-9c4c-4484-901c-ec649e75dddf None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.310240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c3504-9c4c-4484-901c-ec649e75dddf None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.310626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:03.311129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 502/992] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:03.316280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.316558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.316863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:03.321152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:03.322202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:03.325717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 491/993] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 24 14:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:03.328131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:03.344135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:03.345381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:03.436695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 503/994] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:03.465559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f5a25-cdf8-41cd-aafc-c63ddf323e9b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:03.526694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:03.527726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.528187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.528664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.529809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:03.530302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:03.532828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:03.542905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 492/995] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:37:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:03.548624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:03.564772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:03.656647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1e336-a2d9-4c21-9823-a600ac40abeb None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:03.695588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:03.696111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.696435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.696699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.697367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:03.697654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:03.699096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:03.706905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 504/996] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 24 14:37:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:03.713273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:03.754132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:03.819707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:03.838897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ab95d-668d-4279-8c3e-f416e3acd580 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:03.883303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:03.883933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.884208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.884482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.885281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:03.887133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:03.914994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:03.939092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95695d49-a04d-45c2-900e-2b97a29c9c38 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:03.977404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:03.977967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:03.978263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:03.978518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:03.979108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:03.980486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:03.989459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:03.991121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:03.992575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 505/997] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:04.008103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:04.008367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 493/998] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:04.123680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1ec3e-ab73-43c8-b1b5-4f6a49feb150 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:04.170283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:04.171812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.171812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.171812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.172125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:04.172377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:04.173805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:04.176034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:04.180842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 506/999] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:37:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:04.186659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:04.297253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:04.306404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89fa0e-f0a8-4352-9afb-dfafd84aab55 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:04.346064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] RBAC: Adding query filter params (type=compute) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:04.360964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:04.362394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 494/1000] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:37:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:04.364403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:04.502741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a24838-ca9b-4407-bfe4-1a6038e95222 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:04.541944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:04.542559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.542832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.543098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] PATH_INFO: `/v3/endpoints` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.543802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] RBAC: Adding query filter params (interface=public, service_id=50fd6d655be74ece92d3b04b376b9b73, region_id=RegionOne) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:04.544107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:04.545523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15085dbb-a082-4ab8-a6f1-ffd80633aeef None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:04.556615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 507/1001] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:37:04 2022] GET /identity/v3/endpoints?service_id=50fd6d655be74ece92d3b04b376b9b73&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:04.558158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:04.674812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdeeeea-984b-4a87-a29c-9b8c7708becc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:04.720974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:04.721844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.722122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.722386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.722998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:04.724394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:04.728094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bee24-9baf-422a-a5c6-e2bf1bfcfc89 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.728379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bee24-9baf-422a-a5c6-e2bf1bfcfc89 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.728656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bee24-9baf-422a-a5c6-e2bf1bfcfc89 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.730325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 508/1002] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:04.738953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 495/1003] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:37:04 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:04.739168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:04.739168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:04.739168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:04.758896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:04.760157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:04.836879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:04.844862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 509/1004] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:04 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:05.129878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:05.161353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:05.255289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdfa26a-c910-47e2-8878-fb5d70ab804b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:05.293565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:05.294204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:05.294481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:05.294751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] PATH_INFO: `/v3/services/image` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:05.295335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:05.296733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:05.306715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:05.307820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:05.308673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 496/1005] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 14:37:05 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:05.314115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:05.437319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d318e-5e81-4147-b4e1-618752ef1982 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:05.478553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:05.479176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:05.479462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:05.479734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:05.480374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:05.480676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:05.482249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4ff95-474d-4edc-a7d2-f2b228cef9c9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:05.492767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 510/1006] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:05.495504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:05.608751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:05.628916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b4492-8000-409c-9db3-0d3e15e159d3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:05.765108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:05.765618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:05.765889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:05.766173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:05.766792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] RBAC: Adding query filter params (type=image) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:05.767091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:05.768551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1aa444-2fac-43a6-bdc0-831f48371814 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:05.774567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 497/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:06.046945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449889dd-0faf-4129-8030-f8d73b316dcd None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.047154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449889dd-0faf-4129-8030-f8d73b316dcd None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.047410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449889dd-0faf-4129-8030-f8d73b316dcd None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.048800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 511/1008] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:06.054152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.054430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.054705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.075296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:06.076486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:06.152106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 498/1009] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:06.442659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449889dd-0faf-4129-8030-f8d73b316dcd None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:06.509052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:06.555372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449889dd-0faf-4129-8030-f8d73b316dcd None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:06.595150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:06.595888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.596164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.596543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.598102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:06.600260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f3c02-07f2-4010-885d-5192122d31b9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:06.602912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 512/1010] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:06.608604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:06.699284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:06.733682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9244e91-6dc1-431b-81ae-720a412fe304 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:06.772346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:06.772997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.773271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.773538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.774194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:06.775618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:06.824743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c7dc-2254-4860-a1bf-694043e292f0 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.825031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c7dc-2254-4860-a1bf-694043e292f0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.825337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52c7dc-2254-4860-a1bf-694043e292f0 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.826692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 513/1011] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:06.831812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:06.832133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:06.832409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:06.851330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:06.852510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:06.922726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 514/1012] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:06.976820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 499/1013] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:37:06 2022] POST /identity/v3/projects => generated 311 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:07.197331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:07.267923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:07.327814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350620d2-c1d5-4ba9-a755-e0b08c2ee9be None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:07.365269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:07.365911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.366183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.366482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.367066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:07.371594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:07.380395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:07.381662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 14:37:07.382505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:07.387406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 515/1014] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:07.388861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:07.494861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7660a-fba2-4c83-8db0-4b64e8eb2929 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:07.525836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:07.531374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:07.531988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.532262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.532533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.533194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:07.533496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:07.534874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:07.544762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 500/1015] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:07.545756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:07.651756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5382b-9a8f-42e0-b052-6f35d73b9177 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:07.672724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:07.687003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:07.687558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.687833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.688101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.688739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:07.689057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:07.690417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bdf8a1-3edb-4d9f-93d1-f57f497f25a5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:07.704058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 516/1016] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 24 14:37:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:07.705570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:07.765418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd8a7-8ab0-4a39-bd53-d580ca716a2a None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.765721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd8a7-8ab0-4a39-bd53-d580ca716a2a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.765969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd8a7-8ab0-4a39-bd53-d580ca716a2a None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.767584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 517/1017] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:07.772399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.772686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.773001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.792512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:07.793666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:07.825252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e4cc7-0675-4247-8e82-57b0c424e81b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:07.862769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:07.863383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:07.863733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:07.864009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:07.864680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:07.866310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314455d0-adf2-4f05-9b48-d6f5d60b8058 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:07.869266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 518/1018] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:07.962166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 501/1019] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:08.142341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:08.254581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a86fd-d850-44e1-bb84-049ba8ec0304 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:08.278741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:08.306429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:08.307038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:08.307308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:08.307570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:08.308218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:08.309671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ded20-6ad5-4156-bcc6-67d404999951 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:08.480838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 519/1020] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:37:08 2022] POST /identity/v3/services => generated 242 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:08.982664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a8f5-9ef9-44eb-aaa8-6b2a10f93984 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:08.983189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a8f5-9ef9-44eb-aaa8-6b2a10f93984 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:08.983189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96a8f5-9ef9-44eb-aaa8-6b2a10f93984 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:08.984806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 502/1021] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:08.990145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:08.990637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:08.990960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:09.009828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:09.011037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:09.089509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 520/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:09.366552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a8f5-9ef9-44eb-aaa8-6b2a10f93984 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:09.428756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:09.479899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96a8f5-9ef9-44eb-aaa8-6b2a10f93984 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:09.517045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:09.518144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:09.518934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:09.519211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:09.520395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:09.522404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936637a-618a-4e76-be25-a5c588e05d50 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:09.524540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 503/1023] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:09.530109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:09.641894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:09.648972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5996e8-ef42-4b4e-8e94-4e55aca2ccd4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:09.683315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:09.683926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:09.684198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:09.684463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:09.685154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:09.686577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc373-c9b0-4f21-8e57-c0bbbfbf2aca None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:09.805520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 521/1024] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:37:09 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:10.033947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207497-8dca-49ee-b23f-c8dbc43cab0a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.034453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207497-8dca-49ee-b23f-c8dbc43cab0a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.034704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8207497-8dca-49ee-b23f-c8dbc43cab0a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.036225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 504/1025] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:10.042623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b081d-695a-40c2-8cad-c6f38f906794 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.043078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b081d-695a-40c2-8cad-c6f38f906794 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.043153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b081d-695a-40c2-8cad-c6f38f906794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.062697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2a3b081d-695a-40c2-8cad-c6f38f906794 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:10.063883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2a3b081d-695a-40c2-8cad-c6f38f906794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:10.135624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 522/1026] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:10.409974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207497-8dca-49ee-b23f-c8dbc43cab0a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:10.487332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ca03-f477-4c8e-b2fe-ceaa8c5a9cee None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.487620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ca03-f477-4c8e-b2fe-ceaa8c5a9cee None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.487892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575ca03-f477-4c8e-b2fe-ceaa8c5a9cee None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.489431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 523/1027] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:10.494988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.495268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.495541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.514922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:10.516115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:10.530065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8207497-8dca-49ee-b23f-c8dbc43cab0a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:10.554254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:10.571252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:10.571902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.572178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.572448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.585132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:10.590932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:10.595857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:10.597125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 505/1028] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:37:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:10.598336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 524/1029] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:10.601979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:10.729571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa3476-f5b7-4df4-9efd-65bd86b15789 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:10.767868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:10.768474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.768771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.769042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.769708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:10.770059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:10.772188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:10.784761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 506/1030] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:37:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:10.787779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:10.803277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:10.876461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:10.910286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3819049-8d2b-460e-bd13-2752e9dfbdbb None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:10.925186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:10.950305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:10.950936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:10.951209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:10.951474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:10.963977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:10.965716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:10.982483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:10.983537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:10.984487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:10.984487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:10.984487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:10.984487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 525/1031] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:10.989479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.000240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d53e8b-07ba-43ab-b077-3f043c80f8e4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.041204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.041901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.042110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.042386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] PATH_INFO: `/v3/services/image` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.042975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.053822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:11.066069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:11.069614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:11.070497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 507/1032] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 14:37:10 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:11.075828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.087976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.147767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654574-9108-4476-bd20-f5f716a8e2e0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.187958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.188575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.188881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.189146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.189794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:11.190091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.191464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.202192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cd1-f6d6-42a6-8074-2249e82fd2ea None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.206280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 526/1033] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:11.214307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.215527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.252319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.252880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.253315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.253532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.254278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] RBAC: Adding query filter params (name=image) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:11.254577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.256669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.263167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 508/1034] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:11.268534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.329603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f4f5b-2bbc-4e23-ba39-58e0ef6602fb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.355317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.367995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.371522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.371522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.371522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.382652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.384259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.390466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdd6c-c8be-4590-81b4-28e30d41c97a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:37:11.397681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:11.398724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:11.401121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 527/1035] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:11.404742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.439406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.440033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.440336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.440611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.441479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] RBAC: Adding query filter params (type=image) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:11.441659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.443873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.457183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 509/1036] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:11.458382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.501935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.541322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8330a-47cd-40b1-902f-cc6c6fd3efe6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.577298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c11ff5-84f1-4815-807e-2d45582e289e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.581844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.582523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.582809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.583075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.584379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:11.585338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.586240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.606460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 528/1037] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:11.612089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.629580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.630194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.630472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.630839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.631857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] RBAC: Adding query filter params (interface=public, service_id=c41b4775138d4119827715a339aff25e, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:11.632170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.633581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.639177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 510/1038] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/endpoints?service_id=c41b4775138d4119827715a339aff25e&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:11.644646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:11.671000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.736512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f945a9-b9bb-447a-b2a8-9dfb3b1268e4 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.754369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.759235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304f25d-0a70-40f9-a133-df1b3968e5e0 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:11.779869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.780658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.781064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.781543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.796922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:11.797482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.797758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.798026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.798631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.800002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1853-8a79-4e16-a1ef-a4334ae90618 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.816994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 511/1039] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/services => generated 1957 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:37:11.869347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:11.871105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:11.873076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe8b-1e01-48d7-99eb-49033a5383d6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.873368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe8b-1e01-48d7-99eb-49033a5383d6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.873643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abfe8b-1e01-48d7-99eb-49033a5383d6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.875184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 512/1040] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:11.881071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:11.881849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:11.881849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:11.901773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:11.902981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:11.924215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:11.984154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 513/1041] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:12.000744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 529/1042] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:37:12.005362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.106357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.116886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20277cb2-2bac-4283-8fa2-ae4fe69f99c0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.151518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.152163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.152504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.152741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.164376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.165871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:12.182203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:12.183227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:12.184122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:12.184122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:12.184122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:12.188147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 514/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:12.189617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.255267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.300896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66de89-6a43-4f7f-9176-4878de304c45 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.337705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.338736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.338882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.339271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.339948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:12.340251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.341655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.356590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 530/1044] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:12.362265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.365441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.376344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a9ad4-46f9-473a-8bb7-e05395bb442b None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.415161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.415843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.416159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.416433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.426646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:12.431950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:12.432977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:12.433901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 515/1045] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:12.440568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.444690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.486547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814e830-c957-4b35-bc79-4ca72769b605 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.525933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.526682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.526959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.527224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.534964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.536420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:37:12.549746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:12.550709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:12.557290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:12.557730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942d2d8-0c6f-497b-87ca-a49f9041e1c6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.557805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 531/1046] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:12.557805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.595014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.595994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.596352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.596622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.597595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:12.597893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.599248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.609597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 516/1047] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:12.615642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.634343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.676305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ec94a-98ff-4b2b-bc79-46c98068b7f6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.692432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.714881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.715493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.715778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.716047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.716765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:12.717072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.718505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.739372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 532/1048] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:12.739564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87776c1c-609d-4909-9fd1-1fa787219732 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.741195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.776057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.776690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.776992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.777273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] PATH_INFO: `/v3/users/089c788d86634858af67b625e9e22a19` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.793837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] RBAC: Authorizing `identity:get_user(user_id=089c788d86634858af67b625e9e22a19)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.795466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.802127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 517/1049] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/users/089c788d86634858af67b625e9e22a19 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:12.804498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:12.860790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a38eb-4226-49b5-aa87-c0b589f61185 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.886146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.898913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.900948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.900948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.900948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:12.900948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] RBAC: Adding query filter params (role.id=e306d3a2741b44ebb2ee731408f97198, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:12.901269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:12.902690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:12.920753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 533/1050] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e306d3a2741b44ebb2ee731408f97198 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:12.920965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f148b-4f48-4f55-bc65-97e34b954e4f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:12.951121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:12.962314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:12.968294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:12.968294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:12.968294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:13.043116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:13.044588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:13.154697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 518/1051] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:37:13.160736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:13.280334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37865f8c-1f83-4a67-a1b3-216e7e83d0f1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:13.316017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:13.316650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:13.316952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:13.317225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:13.319092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:13.320532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fcf8fc-5357-429c-b882-8447052395a1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:13.322370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 534/1052] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:13 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:13.328246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:13.355193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:13.439829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8280b-4a6d-471b-b7b7-2c569ce6a562 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:13.478677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:13.479289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:13.479563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:13.479832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:13.480560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=28c40d027a184dc2a2836c21b96b62cb, user.id=089c788d86634858af67b625e9e22a19) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:13.480894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:13.482318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3bed0-a6df-423e-a2ee-8ebd3542a1f7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:13.496741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 519/1053] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:13 2022] GET /identity/v3/role_assignments?user.id=089c788d86634858af67b625e9e22a19&scope.project.id=28c40d027a184dc2a2836c21b96b62cb&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:13.802427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2877-75b3-49ae-b6c5-22e9b003647d None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:13.803221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2877-75b3-49ae-b6c5-22e9b003647d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:13.803485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2877-75b3-49ae-b6c5-22e9b003647d None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:13.804877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 535/1054] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:13.812620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:13.812990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:13.813314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:13.837863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:13.839064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:13.916757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 520/1055] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:14.185045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2877-75b3-49ae-b6c5-22e9b003647d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:14.245566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:14.293036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2877-75b3-49ae-b6c5-22e9b003647d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:14.329023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:14.329656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.329935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.330203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] PATH_INFO: `/v3/services/image` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.330789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:14.332163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:14.342110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:14.343147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 14:37:14.344010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:14.350571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 536/1056] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 24 14:37:14 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:14.350717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:14.374926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:14.467299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d69db-90cd-4e60-820e-1cd0a77c82a7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:14.505067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:14.506402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.507189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.507467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.508110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] RBAC: Adding query filter params (name=image) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:14.508413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:14.509832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:14.520146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 521/1057] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:14.521807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:14.641660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377718d5-be89-4238-83fb-cc9996de67df None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:14.659724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:14.677245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:14.678794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.679081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.679353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.679984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] RBAC: Adding query filter params (type=image) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:14.680287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:14.681693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83cc9f-9811-4309-8812-a950b2bf2c4c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:14.691240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 537/1058] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:14.692266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:14.780402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:14.799127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf594d-3c95-4858-ba11-aa636d2ab635 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:14.839602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:14.840223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.840506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.840815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.841757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:14.843146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:14.882694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d2be-ce58-4c4a-856a-ff0defbd0755 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.882975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d2be-ce58-4c4a-856a-ff0defbd0755 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.883243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9d2be-ce58-4c4a-856a-ff0defbd0755 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.884588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 538/1059] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:14.889435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119ac0-8332-45c3-8e5f-c775504ea2a7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:14.889714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119ac0-8332-45c3-8e5f-c775504ea2a7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:14.889984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119ac0-8332-45c3-8e5f-c775504ea2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:14.908234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-79119ac0-8332-45c3-8e5f-c775504ea2a7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:14.909446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-79119ac0-8332-45c3-8e5f-c775504ea2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:14.964674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 522/1060] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:37:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:14.999537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 539/1061] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:15.272212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.394023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2e437-1d91-4cb3-9b61-954844971869 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:15.431308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:15.432009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.432605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.432605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.435822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e57dce-7862-4f76-a425-fdd8a0def7e9 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.436313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e57dce-7862-4f76-a425-fdd8a0def7e9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.436313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e57dce-7862-4f76-a425-fdd8a0def7e9 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.437847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 540/1062] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:15.441619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:15.442703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.443018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.443815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.447658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:15.453644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:15.456370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:15.457510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 523/1063] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:15.461362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.463041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:15.464239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:15.546586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 541/1064] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:15.576412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49eda6-e74a-40ec-b3c7-7cfaca4ccfa9 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:15.611903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:15.612505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.612803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.613071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.613786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:15.614025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:15.616053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:15.624983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 524/1065] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:15.632374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.676611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:15.739047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5dcef-b3ff-4972-a904-e8c4a6995efb None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:15.774130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:15.774752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.775025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.775288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.785243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:15.786693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:15.802079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:15.808923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:15.810065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:15.810065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:15.810065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:15.810065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 542/1066] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:15.811793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.826782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.881991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:15.924498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477a1d7-1ac2-40ca-a46b-309a4bc946b2 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:15.931783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:15.942277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6333717-decd-4675-8204-ddb5b2431ceb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:15.962032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:15.962693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.962979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.963254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.963903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:15.964200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:15.965606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:15.981426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:15.982177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:15.982460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:15.982731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:15.983252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 525/1067] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:15.985556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:15.996219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:16.000946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:16.001884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:16.002728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 543/1068] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:16.008440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.111242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ef0a9-e3bd-46b9-a747-d36c3d2dc16e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.129510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713fcc1-ec03-499f-aa25-fda2214734bf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.134974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.151519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.152190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.152506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.152772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.160225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.162528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.173206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.173812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.174084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.174391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.175054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:16.175352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:37:16.175450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:16.176328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:16.182756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:16.183288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.183377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 526/1069] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:37:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:16.184437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.195769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 544/1070] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:16.197669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.214732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.303655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0550acf5-74b2-4424-8f7e-3a6747057908 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.307022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49eebc-690d-4ecb-aa1b-ec0da4a70481 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.340777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.341392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.341670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.341972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.342667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:16.342968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.344403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.344725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.345478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.345752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.346189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] PATH_INFO: `/v3/users/089c788d86634858af67b625e9e22a19` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.348379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] RBAC: Authorizing `identity:get_user(user_id=089c788d86634858af67b625e9e22a19)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.350431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.352259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 545/1071] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/users/089c788d86634858af67b625e9e22a19 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:16.357718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.364899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 527/1072] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:16.373053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.416657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.456074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.478256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbe8c1-0c49-45ea-b637-a9eb9f477061 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.480835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14607e-32ec-4d51-9774-4bfd13d99b69 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.515189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.515826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.516106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.516394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.517615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.519061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.520837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 546/1073] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:16.522062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.522695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.522970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.523235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.529513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.537222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.538698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:16.553635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:16.554679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:16.556138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:16.556138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:16.556138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:16.556138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 528/1074] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:16.560546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.639444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddfcdc-50c1-411b-8d19-c926432e907d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.661829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.672065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e6529-f62d-4f0a-9705-c4202e79f4d5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.675746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.676413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.676684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.676980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb/users/089c788d86634858af67b625e9e22a19/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.679229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] RBAC: Authorizing `identity:create_grant(project_id=28c40d027a184dc2a2836c21b96b62cb, user_id=089c788d86634858af67b625e9e22a19, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.680659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.707445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.708059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.708316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.708609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.709866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:16.710165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.711539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.723553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 529/1075] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:16.729635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.798611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 547/1076] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:37:16 2022] PUT /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb/users/089c788d86634858af67b625e9e22a19/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:37:16.841141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276eb963-1533-4fc2-9e8b-aa51716ede10 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:16.883807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:16.884466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.884764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.885039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.892749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:16.894130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-2f94e415-ce15-4cf0-81a1-e1437efd5fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:37:16.907873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:16.913452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:16.914346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 530/1077] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:16.917776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:16.934455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:16.965159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dec2-68c4-4697-8c60-146c8902f826 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.965473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dec2-68c4-4697-8c60-146c8902f826 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.965706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7dec2-68c4-4697-8c60-146c8902f826 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.967104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 531/1078] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:37:16.972864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:16.973141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:16.973414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:16.993073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:16.994268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:16.998679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:17.035742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a9101-5cf7-4780-ba1d-c59bc4139e56 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:17.072751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 532/1079] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:17.087278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:17.087889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:17.088161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:17.088425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:17.089853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:17.089853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:17.090979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:17.103861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 548/1080] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:17.109769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:17.218128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d04cd-6dda-4736-afa4-0b6225e69506 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:17.256463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:17.257151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:17.257426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:17.257718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/e306d3a2741b44ebb2ee731408f97198` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:17.260009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=0354722e40a344e9b2196bfa7b3e00e9, role_id=e306d3a2741b44ebb2ee731408f97198)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:17.261476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:17.342926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:17.348747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 533/1081] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:37:17 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/0354722e40a344e9b2196bfa7b3e00e9/roles/e306d3a2741b44ebb2ee731408f97198 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:17.353695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:17.442511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:17.483815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501405a-f426-4628-ba9b-0943769cc8e4 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:17.526082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:17.526792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:17.527274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:17.527274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:17.602495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:17.604023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:17.671704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:17.708283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 549/1082] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:17.714329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:17.820350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d42d-bc24-4405-b696-260826739d6e None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:17.856079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:17.856900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:17.857274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:17.857638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:17.869470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:17.871072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d56120ec-6479-4cbe-a1c1-895d7935bc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:17.886868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:17.888243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:17.889335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:17.889335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:17.889335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:17.892877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 534/1083] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:17.895448 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:18.002852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d306d9-c212-4851-a8ee-d06f796be89d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:18.039182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:18.039786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:18.040063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:18.040331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:18.041735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:18.041735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:18.042985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06d56-77df-4e4f-b64a-db111ab879e2 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:18.060745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 550/1084] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:18.771456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d74-c75e-43d8-87dd-9736c9f190c4 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:18.771966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d74-c75e-43d8-87dd-9736c9f190c4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:18.771966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81d74-c75e-43d8-87dd-9736c9f190c4 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:18.773264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 535/1085] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:18.778714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:18.779163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:18.779263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:18.797924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:18.799109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:18.822327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:18.868629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 551/1086] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:19.138035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81d74-c75e-43d8-87dd-9736c9f190c4 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.192060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:19.240562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81d74-c75e-43d8-87dd-9736c9f190c4 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:19.274458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:19.275082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.275384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.275646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.286270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-3ca85513-8c3c-4b77-b156-591ba86651f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:19.291139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:19.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:19.293594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 536/1087] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:19.298244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.331667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b44ad8-7d88-4ef8-8a2b-1b56e71f4021 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.331950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b44ad8-7d88-4ef8-8a2b-1b56e71f4021 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.332221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b44ad8-7d88-4ef8-8a2b-1b56e71f4021 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.333683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 537/1088] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:19.339192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.339474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.339980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.362946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:19.364169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:19.410108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0ab77-ea2a-4d32-b858-c33fcaf4c5d3 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:19.440932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 538/1089] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:19.445277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:19.445891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.446162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.446431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.447089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:19.447390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:19.448773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:19.457025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 552/1090] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:19.463028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.508130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:19.564433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79529c4-6c94-42b8-bf1e-78e7b1dcafa5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:19.603978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:19.604615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.604920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.605245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] PATH_INFO: `/v3/users/089c788d86634858af67b625e9e22a19` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.606380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] RBAC: Authorizing `identity:get_user(user_id=089c788d86634858af67b625e9e22a19)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:19.607824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:19.609492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 539/1091] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/users/089c788d86634858af67b625e9e22a19 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:19.615904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.638076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:19.714126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.719009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1e100-1b6c-4efd-aa6f-3e2e344f8468 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:19.756122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:19.756760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.757044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.757313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.819617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018a0da-ff76-44c2-9e9f-4d53f88d2ad4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:19.826749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:19.828220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:19.830922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:19.851765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:19.859076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:19.859812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:19.860095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:19.860406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:19.870780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:19.875462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:19.880930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:19.881804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 540/1092] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:19.883207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.933322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 553/1093] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:37:19.939267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:19.987556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6914e5-61c6-4103-9fa2-1858cf66280a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.023584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.024190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.024460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.024754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.025417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:20.025716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.027086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.035204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 541/1094] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:20.040737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f3713-ceb4-4fbf-8523-3ce7308e28fa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.041679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.061078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.071746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.074967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.075613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.075887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.076164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.078445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.080004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.081882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 554/1095] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:19 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:20.088594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.144273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2059d7-0225-4935-8094-f17b495beff7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.181226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.181859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.182135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.182403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.192112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1aee-2c16-4f91-a834-91d47bdb11b0 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.192555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.194683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:20.210551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:20.211533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:20.212422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:20.212422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:20.212422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:20.212422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 542/1096] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:20.216975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.228866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.229480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.229762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.230057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.230822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=28c40d027a184dc2a2836c21b96b62cb, user.id=089c788d86634858af67b625e9e22a19) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:20.231128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.232802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.238897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 555/1097] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/role_assignments?user.id=089c788d86634858af67b625e9e22a19&scope.project.id=28c40d027a184dc2a2836c21b96b62cb&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:20.311534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.329089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e55bdb-74b9-4942-becb-5cf2584a12ca None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.373688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.374325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.374600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.374869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.375522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:20.375826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.377254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.391513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 543/1098] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:37:20.397539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.455101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.505414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1746e-4d59-48f8-b6c7-b91a71c2a1bf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.540826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.541505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.541778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.542046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.549690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.551123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:37:20.562489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:20.563491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:20.564443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 556/1099] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:37:20.569609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.677178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96950ac-4fa9-4c24-b9c7-48274d1af316 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.712598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.713331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.713610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.713873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.714608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:20.714909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.716338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:20.737243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 544/1100] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:20.743243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:20.859099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a88644-47ae-49b8-b59e-1684f7d229cf None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:20.873169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:20.895120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:20.895726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:20.896584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:20.896961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:20.967782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:20.969290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.074293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 557/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:21.080101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:21.083294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:21.199317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f4d56-5247-473b-96cc-ffb57cc3cb91 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:21.234708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:21.235323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:21.235596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:21.235862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:21.246666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:21.248108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:21.263199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:21.264379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:37:21.265350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:21.265350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:37:21.265350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:21.265350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 545/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:21.270084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:21.285234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:21.378604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db2fdb-1d12-48ea-af78-9fc940513599 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:21.416877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:21.417474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:21.417745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:21.418009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:21.418651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:21.418946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:21.420303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.432417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 558/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:21.438022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:21.495048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:21.540861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a381-a73d-40bc-bbb0-5015c706d3b8 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:21.575444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:21.576062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:21.576334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:21.576599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:21.583167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:21.584943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:37:21.596163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:21.597380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:21.598281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 546/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:21.603899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:21.676906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:21.708225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c362816-2164-4b8a-bd0c-b83de338696c None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:21.746048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:21.746582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:21.746857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:21.747125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:21.747816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:21.748118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:21.749641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045db6-e618-41f1-9ee1-c22b92383562 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.762210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 559/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:21.768478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:21.873736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d15be2-5415-4520-bf9f-e3bac2e1837a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:21.887724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:21.907497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:21.908688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:21.908688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:21.908688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:21.909386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] RBAC: Adding query filter params (role.id=e306d3a2741b44ebb2ee731408f97198, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=0354722e40a344e9b2196bfa7b3e00e9) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:21.909696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:21.911144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c408a-6d59-4080-8500-26c10c028c31 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:21.917595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 547/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:21 2022] GET /identity/v3/role_assignments?user.id=0354722e40a344e9b2196bfa7b3e00e9&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e306d3a2741b44ebb2ee731408f97198 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:22.251459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659125-254e-4e8e-a60f-7535ea37dee5 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:22.252134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659125-254e-4e8e-a60f-7535ea37dee5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:22.252134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be659125-254e-4e8e-a60f-7535ea37dee5 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:22.253396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 560/1107] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:22.259363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:22.259814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:22.260100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:22.279990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:22.281218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:22.357025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 548/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:22.626181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659125-254e-4e8e-a60f-7535ea37dee5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:22.751024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be659125-254e-4e8e-a60f-7535ea37dee5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:22.783253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:22.789137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:22.789871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:22.790176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:22.790449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:22.791647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:22.793165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddb3e1-087d-40ac-b77d-3cda9523db95 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:22.794755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 561/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:22.800689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:22.910562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b865a9-77aa-4039-aef2-6158c0c22664 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:22.920948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:22.947037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:22.947639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:22.947912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:22.948222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:22.949063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:22.950491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebd473-07d0-49be-85d9-124cd4c93d91 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:23.089959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 549/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:37:22 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:25.276237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175d63-7ca1-470d-a13b-75768cfff9d0 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:25.276816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175d63-7ca1-470d-a13b-75768cfff9d0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:25.276816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff175d63-7ca1-470d-a13b-75768cfff9d0 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:25.278151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 562/1111] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:25.284065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:25.284475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:25.284698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:25.307123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:25.308383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:25.378474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 550/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:25.685798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff175d63-7ca1-470d-a13b-75768cfff9d0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:25.804888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff175d63-7ca1-470d-a13b-75768cfff9d0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:25.850647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:25.851377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:25.851675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:25.851972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] PATH_INFO: `/v3/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:25.853715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] RBAC: Authorizing `identity:get_role(role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:25.855363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:25.857018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 563/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:25 2022] GET /identity/v3/roles/f9509a8b59544a6ca684faad78f1d96f => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:25.863126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:25.961123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:25.967910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae73404-ea0a-4b78-a520-3c4aaa8c1a7e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:26.003499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:26.004031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:26.004307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:26.004574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] PATH_INFO: `/v3/users/9f917f74b2064ac6bd4b13f23842a8d6` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:26.017544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] RBAC: Authorizing `identity:get_user(user_id=9f917f74b2064ac6bd4b13f23842a8d6)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:26.018972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:26.020657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 551/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:25 2022] GET /identity/v3/users/9f917f74b2064ac6bd4b13f23842a8d6 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:26.028320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:26.096111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:26.129437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544210bc-858a-4fad-8822-116cd58d97d8 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:26.164938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:26.165549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:26.165829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:26.166099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:26.233955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:26.235339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:26.301712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:26.336915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 564/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:26.343027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:26.447703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76065c-43a9-464e-845e-c50e2f75efaf None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:26.485816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:26.486449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:26.486752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:26.487043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:26.488311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:26.490139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd0f9d-fe90-4925-abab-2810f9e28c51 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:26.492012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 552/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:26 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:26.498673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:26.616327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c5591-ca65-4f84-af4f-052c301c4a99 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:26.662095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:26.662860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:26.663183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:26.663487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:26.664367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=28c40d027a184dc2a2836c21b96b62cb, user.id=9f917f74b2064ac6bd4b13f23842a8d6) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:26.664743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:26.666417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2754d84-6eb9-4ff2-861b-6845f2ca5804 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:26.672865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 565/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:26 2022] GET /identity/v3/role_assignments?user.id=9f917f74b2064ac6bd4b13f23842a8d6&scope.project.id=28c40d027a184dc2a2836c21b96b62cb&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:28.621319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d8-2cf3-4f62-9d46-127879a6c3d3 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:28.622045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d8-2cf3-4f62-9d46-127879a6c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:28.622045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2686d8-2cf3-4f62-9d46-127879a6c3d3 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:28.623195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 553/1118] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:28.628544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:28.629015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:28.629113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:28.649666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:28.650832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:28.684951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:28.730748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 566/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:29.016662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2686d8-2cf3-4f62-9d46-127879a6c3d3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:29.048894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:29.143141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2686d8-2cf3-4f62-9d46-127879a6c3d3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:29.190137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:29.190821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:29.191109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:29.191382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] PATH_INFO: `/v3/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:29.194174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] RBAC: Authorizing `identity:get_role(role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:29.195660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:29.197213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 554/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:29 2022] GET /identity/v3/roles/f9509a8b59544a6ca684faad78f1d96f => generated 223 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:29.206043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:29.345904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68967-2d10-446f-8456-21a89376e086 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:29.383916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:29.384878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:29.384878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:29.385154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] PATH_INFO: `/v3/users/9f917f74b2064ac6bd4b13f23842a8d6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:29.386287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] RBAC: Authorizing `identity:get_user(user_id=9f917f74b2064ac6bd4b13f23842a8d6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:29.387730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:29.389382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 567/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:29 2022] GET /identity/v3/users/9f917f74b2064ac6bd4b13f23842a8d6 => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:29.395339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:29.496755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:29.513875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70377e4d-8fc5-4c68-b901-4432c18846b7 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:29.553795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:29.554426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:29.554666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:29.554935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:29.556038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:29.557606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db71ca-f9cc-472f-96f6-23621892b382 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:29.559237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 555/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:29 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:29.565277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:29.598954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:29.670634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3caf3a-265f-4625-be5d-72d3746cb56a None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:29.707022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:29.707682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:29.707963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:29.708266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb/users/9f917f74b2064ac6bd4b13f23842a8d6/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:29.710416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=28c40d027a184dc2a2836c21b96b62cb, user_id=9f917f74b2064ac6bd4b13f23842a8d6, role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:29.711854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1378c-ba50-4a4c-9850-77e3529c52e3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:29.779589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 568/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:37:29 2022] PUT /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb/users/9f917f74b2064ac6bd4b13f23842a8d6/roles/f9509a8b59544a6ca684faad78f1d96f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:31.688047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e12f-c25c-4e60-9cec-a7e51a794d60 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:31.688572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e12f-c25c-4e60-9cec-a7e51a794d60 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:31.688572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67e12f-c25c-4e60-9cec-a7e51a794d60 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:31.689908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 556/1124] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:31.695193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:31.695767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:31.695767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:31.713933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:31.715137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:31.784307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 569/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:32.056751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e12f-c25c-4e60-9cec-a7e51a794d60 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:32.160823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67e12f-c25c-4e60-9cec-a7e51a794d60 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:32.196677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:32.197329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:32.197668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:32.197875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] PATH_INFO: `/v3/roles/f9509a8b59544a6ca684faad78f1d96f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:32.199312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] RBAC: Authorizing `identity:get_role(role_id=f9509a8b59544a6ca684faad78f1d96f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:32.200672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:32.202025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 557/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:32 2022] GET /identity/v3/roles/f9509a8b59544a6ca684faad78f1d96f => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:32.207946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:32.232255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:32.332688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aa483-c2d1-437b-951d-3d5f8325e2e3 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:32.379368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:32.380945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:32.381331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:32.381681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] PATH_INFO: `/v3/users/9f917f74b2064ac6bd4b13f23842a8d6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:32.383145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] RBAC: Authorizing `identity:get_user(user_id=9f917f74b2064ac6bd4b13f23842a8d6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:32.385116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:32.387212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 570/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:32 2022] GET /identity/v3/users/9f917f74b2064ac6bd4b13f23842a8d6 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:32.393128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:32.424239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:32.514665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b61ec3-6a25-4ea5-8826-83703222f865 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:32.550676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:32.551282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:32.551558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:32.552352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:32.624890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:32.626306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:32.657468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:32.734128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 558/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:32.740901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:32.832182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:32.846632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ceb2f-7e4b-4e8f-8a3f-0ba7d883f5c6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:32.885712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:32.886257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:32.886530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:32.886796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] PATH_INFO: `/v3/projects/28c40d027a184dc2a2836c21b96b62cb` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:32.888022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] RBAC: Authorizing `identity:get_project(project_id=28c40d027a184dc2a2836c21b96b62cb)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:32.889562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd43e3-d22b-48ce-b407-0377ba9b3002 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:32.891120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 571/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:32 2022] GET /identity/v3/projects/28c40d027a184dc2a2836c21b96b62cb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:32.897921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:33.002189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68483a8-d61a-4984-a9a9-678c2741706f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:33.027157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:33.037931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:33.038537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:33.038813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:33.039084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:33.039807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] RBAC: Adding query filter params (role.id=f9509a8b59544a6ca684faad78f1d96f, scope.project.id=28c40d027a184dc2a2836c21b96b62cb, user.id=9f917f74b2064ac6bd4b13f23842a8d6) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:33.040114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:33.041666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d050a4fe-f3dc-46b2-8dd0-7c1b99074e26 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:33.047333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 559/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:32 2022] GET /identity/v3/role_assignments?user.id=9f917f74b2064ac6bd4b13f23842a8d6&scope.project.id=28c40d027a184dc2a2836c21b96b62cb&role.id=f9509a8b59544a6ca684faad78f1d96f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:35.021079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb646-3653-4255-bb2d-0fbb3eb1dd63 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:35.021650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb646-3653-4255-bb2d-0fbb3eb1dd63 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:35.021650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb646-3653-4255-bb2d-0fbb3eb1dd63 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:35.023478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 572/1131] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:35.029091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:35.029598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:35.029722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:35.048258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:35.049499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:35.120157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 560/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:35.390317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb646-3653-4255-bb2d-0fbb3eb1dd63 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:35.513482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb646-3653-4255-bb2d-0fbb3eb1dd63 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:35.550644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:35.551265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:35.551545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:35.551814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:35.552965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:35.555930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3743e-a8ed-43f2-bd22-1a99e37c1231 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:35.557986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 573/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:35.565282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:35.672096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cf5ad-d5fc-477b-b91d-fbf5f2fe41a3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:35.690756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:35.708598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:35.709306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:35.709721 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:35.710045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:35.710686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:35.712112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8efcc-fff5-4dcc-ab18-b8e1bbfd48f9 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:35.810939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 561/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:37:35 2022] POST /identity/v3/projects => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:38.054558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc24c9-47e0-4b04-b854-1cebfea6fb93 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:38.055095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc24c9-47e0-4b04-b854-1cebfea6fb93 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:38.055095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc24c9-47e0-4b04-b854-1cebfea6fb93 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:38.056779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 574/1135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:38.062837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:38.063262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:38.063390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:38.083273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:38.085016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:38.157354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 562/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:38.435801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc24c9-47e0-4b04-b854-1cebfea6fb93 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:38.468790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:38.568683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc24c9-47e0-4b04-b854-1cebfea6fb93 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:38.619489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:38.620258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:38.620567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:38.620931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:38.622182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:38.623865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bf073-3607-4a1d-8d0b-0776d79f59fe None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:38.625759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 575/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:38.633039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:38.755533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:38.759629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b569311-7e64-47ce-80a2-1e888317d8bc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:38.798964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:38.799809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:38.800375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:38.800832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:38.801911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:38.804398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723f56d-d291-4649-9aea-88387d5b2045 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:38.920548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 563/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:37:38 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:37:41.185687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd276e-7b8b-4c0d-b099-7e71abf3b4e8 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:41.186282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd276e-7b8b-4c0d-b099-7e71abf3b4e8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:41.186282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd276e-7b8b-4c0d-b099-7e71abf3b4e8 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:41.187605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 576/1139] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:41.193102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:41.193603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:41.193769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:41.214183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:41.215499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:41.300202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 564/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:41.574187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd276e-7b8b-4c0d-b099-7e71abf3b4e8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:41.680604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:41.690076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd276e-7b8b-4c0d-b099-7e71abf3b4e8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:41.724375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:41.725621 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:41.725895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:41.726252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:41.736344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:41.741245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:41.742456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:41.743587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 577/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:41.751701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:41.838612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:41.854625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d4056-dd49-4e16-952c-301d9e65168f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:41.891187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:41.891849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:41.892128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:41.892404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:41.896114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:41.896114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:41.896114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:41.903690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 565/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:41.909968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:42.014631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964823b-8478-4c94-8c9e-88b131c9ff69 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:42.052270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:42.052959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:42.053751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:42.054020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] PATH_INFO: `/v3/users/d90ed4fb89504d26b1749a51ad5585af` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:42.068076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] RBAC: Authorizing `identity:get_user(user_id=d90ed4fb89504d26b1749a51ad5585af)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:42.069719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:42.071408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 578/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:41 2022] GET /identity/v3/users/d90ed4fb89504d26b1749a51ad5585af => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:42.079725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:42.190647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83aef5b-3d4b-4ea3-a03a-19b0787aa6a4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:42.227584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:42.228240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:42.228503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:42.228798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:42.248906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:42.305748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:42.307204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:42.415114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 566/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:42.421185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:42.433532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:42.544018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d649-0b16-4cab-92c6-fae4a7584284 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:42.580114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:42.580781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:42.581158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:42.581426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] PATH_INFO: `/v3/projects/3240a19c056c405181ca2f3970b74473` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:42.582531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] RBAC: Authorizing `identity:get_project(project_id=3240a19c056c405181ca2f3970b74473)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:42.583967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944b066-2a7f-4936-a2a4-880f71b238be None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:42.586190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 579/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:42 2022] GET /identity/v3/projects/3240a19c056c405181ca2f3970b74473 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:42.595425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:42.669406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:42.744726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e0233-c4b0-424d-972b-723a544570a3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:42.793899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:42.794828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:42.795185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:42.795597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:42.796750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=3240a19c056c405181ca2f3970b74473, user.id=d90ed4fb89504d26b1749a51ad5585af) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:42.797209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:42.799463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9cfd-8adc-42fe-9111-1b52e71fec3f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:42.806883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 567/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:42 2022] GET /identity/v3/role_assignments?user.id=d90ed4fb89504d26b1749a51ad5585af&scope.project.id=3240a19c056c405181ca2f3970b74473&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:44.761158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea56dc-38b2-4ef3-956c-81955d0c2841 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:44.761691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea56dc-38b2-4ef3-956c-81955d0c2841 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:44.761691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea56dc-38b2-4ef3-956c-81955d0c2841 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:44.762946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 580/1147] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:44.768230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:44.768660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:44.768827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:44.788827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:44.790027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:44.859522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 568/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:45.138422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea56dc-38b2-4ef3-956c-81955d0c2841 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:45.221530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:45.244915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea56dc-38b2-4ef3-956c-81955d0c2841 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:45.280388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:45.281033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:45.281306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:45.281570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:45.292198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:45.296886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:45.298103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:45.298939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 581/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:45.305332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:45.356400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:45.416437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c201f-23dc-4f69-8487-da9c6746ccb7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:45.455097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:45.455700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:45.455971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:45.456238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:45.456931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:45.457234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:45.458633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:45.468643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 569/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:45.475640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:45.583111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce8f02-d5bd-49cf-b7f6-c5da817516dc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:45.620865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:45.621503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:45.621799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:45.622128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] PATH_INFO: `/v3/users/d90ed4fb89504d26b1749a51ad5585af` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:45.623271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] RBAC: Authorizing `identity:get_user(user_id=d90ed4fb89504d26b1749a51ad5585af)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:45.624747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:45.626360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 582/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:45 2022] GET /identity/v3/users/d90ed4fb89504d26b1749a51ad5585af => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:45.632949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:45.744999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f29beb-a2b5-49c9-a6b4-11c3ca137bb1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:45.747433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:45.778419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:45.779151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:45.779361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:45.779839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] PATH_INFO: `/v3/projects/3240a19c056c405181ca2f3970b74473` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:45.781463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] RBAC: Authorizing `identity:get_project(project_id=3240a19c056c405181ca2f3970b74473)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:45.782915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4098ba-7b64-43fc-8a2e-a6e059ddbda1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:45.784589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 570/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:45 2022] GET /identity/v3/projects/3240a19c056c405181ca2f3970b74473 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:45.791377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:45.800985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:45.897137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7273c83-e44a-4336-a419-85e2dbfd6f26 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:45.934602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:45.935260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:45.935533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:45.935800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] PATH_INFO: `/v3/projects/3240a19c056c405181ca2f3970b74473/users/d90ed4fb89504d26b1749a51ad5585af/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:45.937770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3240a19c056c405181ca2f3970b74473, user_id=d90ed4fb89504d26b1749a51ad5585af, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:45.939326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e654d-04bc-41ff-8c14-4d9077deb3a5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:46.067057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 583/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:37:45 2022] PUT /identity/v3/projects/3240a19c056c405181ca2f3970b74473/users/d90ed4fb89504d26b1749a51ad5585af/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:37:47.984923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77f7b-7d69-4f86-8f33-ce18068eb95d None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.985460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77f7b-7d69-4f86-8f33-ce18068eb95d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.985460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff77f7b-7d69-4f86-8f33-ce18068eb95d None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:47.986822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 571/1154] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:47.993349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:47.993823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:47.993929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.018059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:48.019290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:48.085042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.093081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 584/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:48.368424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77f7b-7d69-4f86-8f33-ce18068eb95d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.480606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff77f7b-7d69-4f86-8f33-ce18068eb95d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.517915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.518555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.518830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.519102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.530553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:37:48.535217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:48.536317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:37:48.537792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 572/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:48.542683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.650237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf92c62-5004-4f66-99bb-7107003c120d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.685937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.686575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.686853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.687122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.687783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:48.688081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.689485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.698941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 585/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:48.704893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.737692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.811032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c1d7-16d9-4fd1-a4d4-9bc4156ba14f None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:48.849327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:48.850463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:48.850743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:48.851008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] PATH_INFO: `/v3/users/d90ed4fb89504d26b1749a51ad5585af` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:48.852140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] RBAC: Authorizing `identity:get_user(user_id=d90ed4fb89504d26b1749a51ad5585af)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:48.853621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:48.855236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 573/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/users/d90ed4fb89504d26b1749a51ad5585af => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:48.861398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:48.921871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:48.967509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef02bae-9a21-4da0-a39b-86e6526b5a43 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.002892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.003563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.003749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.004011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.072305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.073786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.132320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.175909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 586/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:49.182825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.284678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:49.288555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca48d64-0f01-4172-b094-2aa6688a726a None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.324140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.324791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.325071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.325345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] PATH_INFO: `/v3/projects/3240a19c056c405181ca2f3970b74473` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.326466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] RBAC: Authorizing `identity:get_project(project_id=3240a19c056c405181ca2f3970b74473)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.327908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae6105a-90be-4177-8864-7c5f6b75235e None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.329582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 574/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/projects/3240a19c056c405181ca2f3970b74473 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:49.336028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:49.438318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda705b-d841-4264-8b87-3231d87df79b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:49.475453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:49.476152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:49.476433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:49.476702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:49.477471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=3240a19c056c405181ca2f3970b74473, user.id=d90ed4fb89504d26b1749a51ad5585af) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:49.477777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:49.479213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c76a7-d86a-4e14-ac71-99c330a241db None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:49.485536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 587/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:37:49 2022] GET /identity/v3/role_assignments?user.id=d90ed4fb89504d26b1749a51ad5585af&scope.project.id=3240a19c056c405181ca2f3970b74473&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:51.542588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c31a30-2451-430a-b657-bd72c7a29452 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:51.543115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c31a30-2451-430a-b657-bd72c7a29452 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:51.543115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c31a30-2451-430a-b657-bd72c7a29452 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:51.544478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 575/1162] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:51.550745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:51.551180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:51.551612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:51.571135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:51.572335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:51.589763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:51.642687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 588/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:51.918419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c31a30-2451-430a-b657-bd72c7a29452 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.023265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c31a30-2451-430a-b657-bd72c7a29452 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.057960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.058562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.058838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.059108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.102810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.135949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.137439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.252756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 576/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:37:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:37:52.259215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.375897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06703bba-0ac1-4c8f-a6cd-210e41b2755b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.413599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.414249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.414528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.414799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.422061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.423524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-dc91ca91-abe3-470d-be4f-871d4b96b425 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:37:52.435422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:37:52.436507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:37:52.437815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 589/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:37:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:37:52.444415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:52.513139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:52.549289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b580-0aa5-41ed-a311-ec877ac2e2fc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:52.594668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:52.595276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:52.595552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:52.595817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:52.596461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:37:52.596788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:52.598415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c232ce-d432-4ccd-85c0-f40e3b92797f None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:52.606097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 577/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 24 14:37:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:54.534861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec64a-2d1a-45ec-a6a6-464d5867ea59 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:54.535447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec64a-2d1a-45ec-a6a6-464d5867ea59 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:54.535447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec64a-2d1a-45ec-a6a6-464d5867ea59 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:54.536765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 590/1167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:54.543305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df790-ba02-48fb-a394-792e208a4dc4 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:54.543822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df790-ba02-48fb-a394-792e208a4dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:54.543822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09df790-ba02-48fb-a394-792e208a4dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:54.562428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a09df790-ba02-48fb-a394-792e208a4dc4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:54.563630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a09df790-ba02-48fb-a394-792e208a4dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:54.633100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 578/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 14:37:54.912308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec64a-2d1a-45ec-a6a6-464d5867ea59 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:54.928625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:55.023403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ec64a-2d1a-45ec-a6a6-464d5867ea59 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:55.059021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:55.059623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:55.059895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:55.060162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:55.060861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:55.062227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62409fa-dab5-4583-aa9e-1160a193fcd1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:55.126090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 591/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Aug 24 14:37:54 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:57.107685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9606-84de-4e77-8a62-9053ade4a05f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.108238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9606-84de-4e77-8a62-9053ade4a05f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.108238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c9606-84de-4e77-8a62-9053ade4a05f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.109643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 579/1170] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:57.114990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62918-c303-412b-ad6b-e169201127da None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.115458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62918-c303-412b-ad6b-e169201127da None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.115755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d62918-c303-412b-ad6b-e169201127da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.134451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-71d62918-c303-412b-ad6b-e169201127da None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:37:57.135647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-71d62918-c303-412b-ad6b-e169201127da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:37:57.208394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 592/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:37:57.499597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c9606-84de-4e77-8a62-9053ade4a05f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:57.567160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:57.612799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c9606-84de-4e77-8a62-9053ade4a05f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:57.651685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:57.652313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.652834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.653304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] PATH_INFO: `/v3/domains/ba629a94687d4f5297cbe89a0bae4c9b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.671019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba629a94687d4f5297cbe89a0bae4c9b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:57.673306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4919596-7a4c-4612-9512-4f09c66d9e06 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:57.677214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 580/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 24 14:37:57 2022] GET /identity/v3/domains/ba629a94687d4f5297cbe89a0bae4c9b => generated 267 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:37:57.684363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62918-c303-412b-ad6b-e169201127da None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:37:57.686574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:37:57.806927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d62918-c303-412b-ad6b-e169201127da None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:37:57.846487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:37:57.847087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:57.847618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:57.847893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:57.848527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:37:57.850511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cbd51-b822-43f2-9d1a-b0ac4de2a2bd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:37:57.978517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 593/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:37:57 2022] POST /identity/v3/projects => generated 361 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:37:59.982829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1d0f-5d5d-401e-9872-1e56165e1f9c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.983387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1d0f-5d5d-401e-9872-1e56165e1f9c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.983387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd1d0f-5d5d-401e-9872-1e56165e1f9c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:37:59.984738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 581/1174] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:37:59.990284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:37:59.990757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:37:59.990860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.009119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:00.010336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:00.063161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:00.081312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 594/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:38:00.355470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1d0f-5d5d-401e-9872-1e56165e1f9c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:00.466483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd1d0f-5d5d-401e-9872-1e56165e1f9c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:00.489282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:00.500812 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:00.501470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.501745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.502016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] PATH_INFO: `/v3/domains/ba629a94687d4f5297cbe89a0bae4c9b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.503157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ba629a94687d4f5297cbe89a0bae4c9b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:00.504637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5df035-55cb-4b83-a60e-4f5f76d7ab29 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:00.506751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 582/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 24 14:38:00 2022] GET /identity/v3/domains/ba629a94687d4f5297cbe89a0bae4c9b => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:00.512947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:00.614385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b4f7c-273a-4cae-9c9e-0821d41427b0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:00.650789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:00.651398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:00.651674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:00.651938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:00.652591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:00.654059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e82f35-a254-40c3-a087-c624ecb4fe55 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:00.768516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 595/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:38:00 2022] POST /identity/v3/users => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:38:02.757225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25e58-5688-47db-8b64-73ae9b87c8e8 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.757765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25e58-5688-47db-8b64-73ae9b87c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.757765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25e58-5688-47db-8b64-73ae9b87c8e8 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.759036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 583/1178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:02.765048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:02.765576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:02.765576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:02.785944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:02.788222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:02.826547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:02.862102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 596/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:38:03.132445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b25e58-5688-47db-8b64-73ae9b87c8e8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.242128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b25e58-5688-47db-8b64-73ae9b87c8e8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.276399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.277046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.277323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.277593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.289321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:38:03.293974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:38:03.295264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:38:03.296262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 584/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:38:03.301363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.406617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb5cf8-44cb-4cf7-9dee-05304ed75b76 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.440152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba81a-4f23-4482-928b-925352099381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.440782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba81a-4f23-4482-928b-925352099381 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.441060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba81a-4f23-4482-928b-925352099381 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.441328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba81a-4f23-4482-928b-925352099381 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.441990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba81a-4f23-4482-928b-925352099381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:03.442288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba81a-4f23-4482-928b-925352099381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.444318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba81a-4f23-4482-928b-925352099381 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.452527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 597/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:03.459360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.521005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:03.573672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2573-af10-4f62-8774-ae28b4ab98dd None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.610190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.610810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.611087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.611359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] PATH_INFO: `/v3/users/5d599293e3af404caecf31d160055855` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.625440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] RBAC: Authorizing `identity:get_user(user_id=5d599293e3af404caecf31d160055855)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.626891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.628509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 585/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/users/5d599293e3af404caecf31d160055855 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:03.635234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba81a-4f23-4482-928b-925352099381 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:03.667543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:03.738035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba81a-4f23-4482-928b-925352099381 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:03.772946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:03.773614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:03.773821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:03.774101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:03.843127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:03.844580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:03.875385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:03.949585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 598/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:38:03.955488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.056858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915a1c5-4328-4ebe-885f-95ca5510b649 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:04.066057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:04.091873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:04.092506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.092804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.093116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] PATH_INFO: `/v3/projects/8984f3c83fc94f0882f6b86148f42e49` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.094349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] RBAC: Authorizing `identity:get_project(project_id=8984f3c83fc94f0882f6b86148f42e49)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:04.096230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99107734-a399-452d-9eb4-fb215a6d63ee None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:04.098180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 586/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:38:03 2022] GET /identity/v3/projects/8984f3c83fc94f0882f6b86148f42e49 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:04.104636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:04.213940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a6787-aaaf-4939-87fd-8e3635ed7fd7 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:04.246836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:04.251696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:04.252305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:04.252578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:04.252880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:04.253632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=8984f3c83fc94f0882f6b86148f42e49, user.id=5d599293e3af404caecf31d160055855) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:04.253941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:04.255897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd78e40-6410-44ed-a50b-99f939a08c4e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:04.262326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 599/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:38:04 2022] GET /identity/v3/role_assignments?user.id=5d599293e3af404caecf31d160055855&scope.project.id=8984f3c83fc94f0882f6b86148f42e49&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:06.182222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc833ceb-9cab-42b9-bcf4-505b18b13bb3 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.183341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc833ceb-9cab-42b9-bcf4-505b18b13bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.183341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc833ceb-9cab-42b9-bcf4-505b18b13bb3 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.184345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 587/1186] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:06.190603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.190603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.194290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.214432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:06.215638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:06.288897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 600/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:38:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:38:06.602010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc833ceb-9cab-42b9-bcf4-505b18b13bb3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:06.714271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc833ceb-9cab-42b9-bcf4-505b18b13bb3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.751695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.752366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.752645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.752953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.764730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:38:06.769450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:38:06.770589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:38:06.772422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 588/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:38:06.777633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:06.893770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f78b7-3cff-4599-ba1e-492ab4601885 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:06.929059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:06.938703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:06.939308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:06.945103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:06.945103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:06.945103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:06.945103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:06.945103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:06.951311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 601/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:06.959268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.007753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.088108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b103-f862-4192-a9eb-db0a79df3428 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.134071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.134741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.135069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.135341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] PATH_INFO: `/v3/users/5d599293e3af404caecf31d160055855` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.136514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] RBAC: Authorizing `identity:get_user(user_id=5d599293e3af404caecf31d160055855)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.138086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.139702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 589/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:38:06 2022] GET /identity/v3/users/5d599293e3af404caecf31d160055855 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:07.149028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.264226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4b2b1-90f3-4a8d-834f-26cf35404d08 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.306077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.306702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.306975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.307241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] PATH_INFO: `/v3/projects/8984f3c83fc94f0882f6b86148f42e49` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.308384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] RBAC: Authorizing `identity:get_project(project_id=8984f3c83fc94f0882f6b86148f42e49)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.309983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e902f-6bb1-46d3-8233-4668d8b1f25d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.311833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 602/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:38:07 2022] GET /identity/v3/projects/8984f3c83fc94f0882f6b86148f42e49 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:07.318741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:07.431907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf7e59-9f70-475d-9573-520814223068 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:07.434137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:07.467081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:07.467734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:07.468012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:07.468280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] PATH_INFO: `/v3/projects/8984f3c83fc94f0882f6b86148f42e49/users/5d599293e3af404caecf31d160055855/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:07.470209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] RBAC: Authorizing `identity:create_grant(project_id=8984f3c83fc94f0882f6b86148f42e49, user_id=5d599293e3af404caecf31d160055855, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:07.471636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7baac-01ef-41c5-a8e9-40cbac577778 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:07.543636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 590/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:38:07 2022] PUT /identity/v3/projects/8984f3c83fc94f0882f6b86148f42e49/users/5d599293e3af404caecf31d160055855/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:38:09.464942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4d7d-b7be-4b03-8a70-05321362d8b4 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:09.465492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4d7d-b7be-4b03-8a70-05321362d8b4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:09.465492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4d7d-b7be-4b03-8a70-05321362d8b4 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:09.466819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 603/1193] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:38:09.472023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:09.472422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:09.472862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:09.490929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:38:09.492101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:38:09.558156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 591/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:38:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:38:09.825133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4d7d-b7be-4b03-8a70-05321362d8b4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:09.883108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:09.927519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4d7d-b7be-4b03-8a70-05321362d8b4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:09.972844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:09.973470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:09.973775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:09.974045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:09.985727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:38:09.991097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:38:09.992253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:38:09.993200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 604/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:38:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:38:09.998483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.101251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.107879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086fac8-9c17-4b9e-974a-33963284d097 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.142035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.142640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.142916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.143187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.143848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:10.144148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.145553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.154333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 592/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:10.161871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.264900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ad0a9-2a23-4e5c-956a-ef4edeef6043 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.280905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.298518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.299213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.299459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.299726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] PATH_INFO: `/v3/users/5d599293e3af404caecf31d160055855` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.300867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] RBAC: Authorizing `identity:get_user(user_id=5d599293e3af404caecf31d160055855)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.302874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.304649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 605/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 24 14:38:10 2022] GET /identity/v3/users/5d599293e3af404caecf31d160055855 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:10.310886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.418400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8741ed1-5b25-4c4f-b397-b140b70c976c None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.452473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.453111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.453388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.453654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.479411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.521252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.522776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.619971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 593/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:38:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:38:10.626124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.725620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912edc1-65c1-4141-a68a-885f20970c23 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.778259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.778873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.779153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.779470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] PATH_INFO: `/v3/projects/8984f3c83fc94f0882f6b86148f42e49` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.782403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] RBAC: Authorizing `identity:get_project(project_id=8984f3c83fc94f0882f6b86148f42e49)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.782403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd647f52-ce38-482d-ad50-4389b833bb21 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.783734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 606/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 24 14:38:10 2022] GET /identity/v3/projects/8984f3c83fc94f0882f6b86148f42e49 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:10.790789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:38:10.848336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:10.892661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c222f60-2944-4d78-bbb9-8ef6e164a200 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:38:10.927569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:38:10.928164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:38:10.928446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:38:10.928747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:38:10.929479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=8984f3c83fc94f0882f6b86148f42e49, user.id=5d599293e3af404caecf31d160055855) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:38:10.929875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:38:10.931231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9c26-39db-49e1-8bb1-cece13192f72 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:38:10.936982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 594/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:38:10 2022] GET /identity/v3/role_assignments?user.id=5d599293e3af404caecf31d160055855&scope.project.id=8984f3c83fc94f0882f6b86148f42e49&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:38:20.773745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=74 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:38:20.934912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=40 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:28.844266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf509-fafc-4db2-b6b3-70cf75c5cc40 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.844900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf509-fafc-4db2-b6b3-70cf75c5cc40 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.845006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50faf509-fafc-4db2-b6b3-70cf75c5cc40 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.846269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 607/1201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:28.851953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:28.853061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:28.853061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:28.873860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:28.876012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:28.978726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 595/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:29.253396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faf509-fafc-4db2-b6b3-70cf75c5cc40 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.371762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50faf509-fafc-4db2-b6b3-70cf75c5cc40 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.418284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.419165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.419607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.419949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.438367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.440652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:29.456600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:29.459865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:29.476155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:29.476155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:29.476155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:29.476155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 608/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:29.476464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.591614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b945db-626c-43d1-ad40-a6b8b5304628 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.650031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:29.659377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.660123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.660392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.660675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.661359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:29.661661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.663544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf735-ba77-4e7b-a19e-77471a47ceaa None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.683065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 596/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:29.691829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:29.764473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:29.829786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f58309-11d6-4428-97f8-3851f32179a8 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:29.880601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:29.882094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:29.882094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:29.882094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:29.882608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:29.884337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0293348-b7c1-491b-b598-da83c9e3e587 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:29.957392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 609/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 24 14:39:29 2022] POST /identity/v3/users => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:39:31.915570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101bd9e-95e9-47b0-a473-3579f1949117 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:31.916130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101bd9e-95e9-47b0-a473-3579f1949117 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:31.916130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101bd9e-95e9-47b0-a473-3579f1949117 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:31.917823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 597/1206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:31.923208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:31.923631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:31.931813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:31.943946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:31.945182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:32.016456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 610/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:32.293185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101bd9e-95e9-47b0-a473-3579f1949117 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.426346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101bd9e-95e9-47b0-a473-3579f1949117 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.466142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.466822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.467093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.467359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.479590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:32.484514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:32.485695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:32.486606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 598/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:32.492116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.534370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:32.600323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86527ddb-5741-47cc-9729-df14fbc81734 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.635812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.636422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.636701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.637009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.637676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:32.637978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.639423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.647727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 611/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:32.654174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.722418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:32.780213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bde85-b840-4c56-a7a3-0daf0200a2fe None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:32.815975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:32.816612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:32.816925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:32.817196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:32.832145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:32.832145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:32.850433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:32.851611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:32.852548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:32.852548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:32.852548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:32.852548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 599/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:32.858274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:32.970217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:32.973346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3519e4-c646-4a62-a78b-c8f649374828 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.009117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.013959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.027705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 612/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:33.033565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.139150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f96c-37d9-43f7-bd49-1a17f22fe050 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.140603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:33.175410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.176081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.176362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.176637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.184052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.185527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:33.200001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:33.207437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:33.208580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 600/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:33.209252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.313694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b188f-5dd9-4825-8a70-297f91160ffd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.348273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.349215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.349502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.349751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.350469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:33.350770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.352344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.371803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 613/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:33.377624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.487146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81bf910-60bf-46d6-813a-807d01448cbc None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.526354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.534097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.534097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.534097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.558692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:33.596369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.597883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.715617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 601/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:33.721728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.742220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:33.833889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28a10f-5007-4144-8ede-7d7942b8e3cd None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:33.871569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:33.872196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:33.872473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:33.872770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:33.883032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:33.885154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:33.899999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:33.901428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:33.902596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:33.902596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:33.902596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:33.902596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 614/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:33.907197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:33.971378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.014352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005c1e1-57e6-4238-b2b3-2f80c9367c48 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.049584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.050221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.050456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.050724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.051361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:34.051659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.053044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.066528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 602/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:34.072525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.144562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.177147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f684e3a-32ac-4242-af03-3ee644042752 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.210216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.210833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.211106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.211984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.218822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.220262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:34.232858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:34.233982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:34.234901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 615/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:34.239887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.344520 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdf12-3ca2-4bf7-bb57-305f87ef80ba None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.368795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.384288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.384288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.384288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.384288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.384684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:34.384808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.386239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3df7c2-bf89-4071-aa0a-ce64360f1bb2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.398518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 603/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:34.405768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:34.514587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e033e-8ed0-48dd-b669-76acf93a09fa None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:34.546213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:34.551986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:34.552585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:34.552887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:34.553158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:34.553964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=776bd34229a4419495ec77bd62fb9ea7) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:34.554269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:34.555873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49acc14-f382-4b95-895c-cf440ab4ea91 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:34.561306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 616/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:39:34 2022] GET /identity/v3/role_assignments?user.id=776bd34229a4419495ec77bd62fb9ea7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:36.502515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af90af-3e14-4fd2-953b-793a5e9423ed None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.503034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af90af-3e14-4fd2-953b-793a5e9423ed None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.503126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af90af-3e14-4fd2-953b-793a5e9423ed None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.504418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 604/1220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:36.510521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:36.510985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:36.511087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:36.529312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:36.530511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:36.597758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 617/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:36.875209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af90af-3e14-4fd2-953b-793a5e9423ed None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:36.989321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af90af-3e14-4fd2-953b-793a5e9423ed None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.026198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.026822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.027102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.027369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.038213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:37.043449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:37.047791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:37.048672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 605/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:37.050811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.153338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976e80f-0d78-4099-8db4-b828684e808e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.177667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:37.188105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.188704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.189007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.189329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.189973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:37.190271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.191634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.202541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 618/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:37.205741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.253098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:37.310712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1986992-d2d7-471a-aa43-1cd20da5a029 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.344273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.344918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.345197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.345467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.357932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.359423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:37.373780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:37.375111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:37.376380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:37.376380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:37.376380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:37.376380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 606/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:37.380814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.486853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd488c-3c16-4bc3-a3ff-0d72d3ed10b3 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.521364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.521983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.522237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.522507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.523146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:37.523446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.525976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.537800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 619/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:37.544277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.644373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:37.652276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ac53d-fa67-4300-8e15-e5b2b7e48b0d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.690992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.691647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.691931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.692173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.701270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.702720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:37.715681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:37.716866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:37.718042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 607/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:37.723270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:37.803276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:37.874196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709f1b9-8ae7-4fc9-889c-174f59345f00 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:37.912176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:37.912817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:37.913095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:37.913377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:37.914091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:37.914430 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:37.915877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:37.933616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 620/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:37.939384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.041988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3616a78-9a93-4678-bbd1-1d68f2ca14e5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.076593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.077170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.077446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.077716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.088318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.089808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:38.103920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:38.105137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:38.106424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:38.106424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:38.106424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:38.106424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 608/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:38.111402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.214849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ee37d-9bc5-4d8a-bec2-1dbb353e2dd1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.217183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:38.250218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.250818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.251092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.251358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.251989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:38.252338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.254022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.265518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 621/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:38.271377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.282388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:38.373782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526734cd-5c4e-4a57-b970-bde516974a31 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.408456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.409110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.409383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.409649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.416925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.418408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:38.429515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:38.431326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:38.432464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 609/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:38.437270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.542555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d5ef8-d0ce-4f86-b5a8-bb2e11e729cc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.577935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.578672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.578943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.579207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.579942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:38.580239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.581831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4a642-b37d-46a5-bba2-1693e9061f6b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.597468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 622/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:38.605155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:38.677859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:38.714052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54dad8d-7a42-488b-ad99-9367497dff42 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:38.751770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:38.752433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:38.752740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:38.753016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/776bd34229a4419495ec77bd62fb9ea7/roles/e7d037659771432197be501a15d207ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:38.768139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=776bd34229a4419495ec77bd62fb9ea7, role_id=e7d037659771432197be501a15d207ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:38.769620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a916ec-ecde-4f9a-ba24-e4ebfdc46dc2 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:38.860856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 610/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:39:38 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/776bd34229a4419495ec77bd62fb9ea7/roles/e7d037659771432197be501a15d207ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:40.963503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5cd8-964c-4dc7-b447-1137bd084756 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.964071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5cd8-964c-4dc7-b447-1137bd084756 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.964165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5cd8-964c-4dc7-b447-1137bd084756 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.966107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 623/1233] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:40.972067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:40.974227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:40.974227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:40.991904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:40.993853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:41.064072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 611/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:41.333591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce5cd8-964c-4dc7-b447-1137bd084756 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:41.359918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:41.438576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce5cd8-964c-4dc7-b447-1137bd084756 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:41.473109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:41.474288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:41.474764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:41.475133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:41.487121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:41.491740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:41.493810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:41.496076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 624/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 24 14:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:41.499728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:41.546295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:41.603617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246a44e-8069-4484-91a9-7a8262a26c57 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:41.640006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:41.640598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:41.640903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:41.641172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:41.641831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] RBAC: Adding query filter params (name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:41.642129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:41.643620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:41.652446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 612/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 24 14:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:41.658607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:41.781013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:41.800454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2935a-6e73-42a9-8e8b-b72781ad1967 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:41.837424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:41.838209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:41.838551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:41.838820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:41.855147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:41.857036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:41.871953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:41.873120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:41.874484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:41.874484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:41.874484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:41.874484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 625/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:41.879206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.028876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad0553-a591-45d2-b175-561fa7b5ffca None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.042323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:42.067399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.067974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.068254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.068528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.069207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:42.069510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.071963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.084242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 613/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:42.090787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.192600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc0c6b-128d-4ffa-852e-d2a426104191 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.227513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.228233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.228507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.228801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.231552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:42.236811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.238254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:42.249414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:42.250631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:42.251582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 626/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:42.256468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.366765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e1aa-8cb2-48c3-a07c-c2b13332bdb5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.404619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.405249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.405525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.405793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.406521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:42.406820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.408234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.426841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 614/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:42.433181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.537484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83c136-61b7-4eae-b882-36c07ac86625 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.572436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.573081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.573358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.573629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.638318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:42.645035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.646534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.763265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 627/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:39:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 14:39:42.769327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:42.797491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:42.869963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f9276-1fbe-4b0a-9c44-843e3898c8a6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:42.905244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:42.905868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:42.906146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:42.906417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:42.917655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:42.919172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:42.936099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:42.937334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:42.938527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:42.938527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:42.938527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:42.938527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 615/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:42.943220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.037129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:43.043663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6553ec-263b-493e-a305-0b032839afd9 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.078292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.078818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.079108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.079379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.080020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:43.080414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.081736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.102033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 628/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:43.110002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.194276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:43.215987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c37b05-c346-4a8e-8e50-9ae6d6c43b44 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.252764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.253402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.253679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.253948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.260893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.262401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:43.273505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:43.275283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:43.276316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 616/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:43.281143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.387063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06657f-719d-4868-9596-993c7ea5a8e1 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.423674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.424274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.424551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.424852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.425553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:43.431013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.431013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82349d-d9de-4834-a942-1cd4d71079a4 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.440143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 629/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:43.447087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:43.554756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4b87d-ee94-4fb5-aec3-f11ed483660d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:43.589909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:43.590517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:43.590794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:43.591065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:43.591796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] RBAC: Adding query filter params (role.id=e7d037659771432197be501a15d207ee, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=776bd34229a4419495ec77bd62fb9ea7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:43.592104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:43.593574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cba53c8-9d1b-4dd0-8cf6-caaa4eae8e98 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:43.600050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 617/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:39:43 2022] GET /identity/v3/role_assignments?user.id=776bd34229a4419495ec77bd62fb9ea7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=e7d037659771432197be501a15d207ee => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:45.737068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803477-dae8-4f0d-9e91-297fb9cc5491 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.737775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803477-dae8-4f0d-9e91-297fb9cc5491 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.737775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40803477-dae8-4f0d-9e91-297fb9cc5491 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.739029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 630/1247] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:45.745717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:45.746222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:45.746222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:45.752694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:45.768472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:45.769799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:45.845326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 618/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:46.123109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40803477-dae8-4f0d-9e91-297fb9cc5491 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.142609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.232957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40803477-dae8-4f0d-9e91-297fb9cc5491 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.269964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.270857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.271811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.272092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.283730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:46.288936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:46.290035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:46.291255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 631/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:46.296454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.423374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2baed47-a04a-4be8-9b14-1ec8c789f444 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.474835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.481312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.481930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.482208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.482479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.483152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:46.483454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.484869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.493821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 619/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:46.501244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.588254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.610824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01deff6-c190-4fcb-922e-96b885159bac None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.645097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.645670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.645926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.646196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.658101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.659556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:46.673422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:46.674579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:46.675488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:46.675488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:46.675488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:46.675488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 632/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:46.680903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.787043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276dcd5-032b-4d1d-b4f4-5e72c74a6228 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.824095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.824745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:46.825030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:46.825294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:46.825935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:46.826233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:46.827675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:46.840236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 620/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:46.846095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:46.960123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c65b3-f31e-492b-8bb2-048f3ef938fc None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:46.990160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:46.999119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:46.999734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.000002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.000273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.007831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.010608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:47.021915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:47.023064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:47.024338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 633/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:47.029724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.089472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.135743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115871b-938b-4a95-ab23-41c41efd1893 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.171632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.172237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.177246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.177246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.177246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:47.177246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.177246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.193773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 621/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:47.199796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.309037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a308fb-15ab-46b0-bf0b-6c117503aa53 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.344589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.345215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.345486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.345803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.406257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.422358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.423872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.534999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 634/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:47.541813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.648547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ab2b5-c7ac-4b47-9687-94b9fd689bfe None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.662856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.685313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.686424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.686424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.686424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.696586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.698043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:47.713616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:47.714769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:47.715751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:47.715751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:47.715751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:47.715751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 622/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:47.720572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:47.812252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:47.824771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff9779-2cad-439b-a0d1-a4fabd30ec8d None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:47.861406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:47.862207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:47.862674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:47.863138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:47.864264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:47.864850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:47.867343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:47.884476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 635/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:47.890399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:48.001607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70583e8e-0f2d-480a-8fdd-3dd04a27d793 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:48.038722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:48.039412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:48.039690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:48.039961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:48.047931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:48.049472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:48.062661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:48.063826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:48.065145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 623/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 14:39:48.073971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:48.185790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be53d5-1222-4d99-b88f-1eb302c9a6a6 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:48.225921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:48.226538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:48.226867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:48.227850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:48.228558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:48.228906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:48.230358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1ba43-42da-4c2f-a077-a329776ca138 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:48.243405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 636/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:48.249880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:48.279159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:48.359269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e3583-8615-4f46-9a60-47757522a4ac None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:48.396078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:48.396737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:48.397024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:48.397293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:48.398015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=776bd34229a4419495ec77bd62fb9ea7) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:48.398321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:48.400098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd9b2f2-f0b8-4072-a6a9-90fa4c9f913b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:48.405869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 624/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:39:48 2022] GET /identity/v3/role_assignments?user.id=776bd34229a4419495ec77bd62fb9ea7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:50.331961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d57c8-2970-42c5-864d-b3bcd864842e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:50.332548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d57c8-2970-42c5-864d-b3bcd864842e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:50.332548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d57c8-2970-42c5-864d-b3bcd864842e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:50.333940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 637/1261] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:50.339881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:50.344421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:50.344421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:50.359163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:50.360385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:50.440100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 625/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:50.714338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d57c8-2970-42c5-864d-b3bcd864842e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:50.725793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:50.833402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d57c8-2970-42c5-864d-b3bcd864842e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:50.874240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:50.874876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:50.875148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:50.875419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:50.887782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:50.892651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:50.893617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:50.894468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 638/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:39:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:50.901694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:50.928540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.058745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42144768-f7d8-4042-ae25-14f8f9504edb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.110537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.111186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.111464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.111734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.112406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:51.112706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.114110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.122498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 626/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:51.128436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.202502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.240111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad32113-72b5-41ca-b729-3e995920679e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.276736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.277381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.277750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.277922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.288374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.290500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:51.306261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:51.307497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:51.308916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:51.308916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:51.308916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:51.308916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 639/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:51.313288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.401487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.424140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e809-25e6-4631-a4a1-d8694291ae66 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.459556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.460173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.460453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.460755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.462220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:51.462408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.463809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.476237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 627/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:51.482227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.587197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac361f1-8234-43a4-81e2-82e2b8409557 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.607071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.621490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.622119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.622416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.622668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.630443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.631885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:51.643609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:51.644763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:51.645941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 640/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:51.650874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.757265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0a82-2022-4e88-aa5d-420492e752a3 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.792571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.793206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.793483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.793752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.794475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:51.794777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.796340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.805283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:51.813750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 628/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:51.820136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:51.923496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a069e9-057c-4843-b718-ebe0b243503e None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:51.958276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:51.958904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:51.959213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:51.959520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:51.970974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:51.972424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:51.987029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:51.991610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:51.992548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:51.992548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:51.992548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:51.992548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 641/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:51.994404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.104148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39cc67-cb7d-479e-a56f-d2e3386f9815 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.140017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.140621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.140924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.141195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.141837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:52.142138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.143564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.155452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 629/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:52.161431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.201763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:52.278638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d56d10-a3d4-4413-bc3f-d237d19858a8 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.315447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.316081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.316360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.316633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.325424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.326898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:52.338969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:52.351608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:52.353365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 642/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:52.354342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.422076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:52.466648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c84a64-a28e-4fdf-93cf-371053d70ebf None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.512306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.512984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.513259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.513530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.514225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:52.514528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.516063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5132367-1bfd-4ce0-927c-8bf022ae410c None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.530406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 630/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:52.537582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:52.641490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:52.657585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65e8ae-c96a-465d-9ccf-799112469e24 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:52.702123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:52.702791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:52.703066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:52.703337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] PATH_INFO: `/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/776bd34229a4419495ec77bd62fb9ea7/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:52.705252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c5d7e2b381046af9424801ec7cd7ee0, user_id=776bd34229a4419495ec77bd62fb9ea7, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:52.707067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790f3dc-5815-47b7-a7f2-148f925f16c3 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:52.855902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 643/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 24 14:39:52 2022] PUT /identity/v3/projects/9c5d7e2b381046af9424801ec7cd7ee0/users/776bd34229a4419495ec77bd62fb9ea7/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:39:54.834689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc765dfe-558d-4603-9be4-e54ea2d075fe None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.835257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc765dfe-558d-4603-9be4-e54ea2d075fe None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.835257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc765dfe-558d-4603-9be4-e54ea2d075fe None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.838673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 631/1274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:54.850741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:54.851212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:54.851301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:54.871613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:54.872864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:54.945740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 644/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:55.222030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc765dfe-558d-4603-9be4-e54ea2d075fe None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.324849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc765dfe-558d-4603-9be4-e54ea2d075fe None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.342574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.359984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.360608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.362161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.362161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.371634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 14:39:55.376245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:55.377235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:55.378579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 632/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:55.384731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.467874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.486923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109acf9a-1428-4c7c-a97a-735dd7f37d2e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.522651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.524007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.524291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.524563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.525256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:55.525598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.527056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.535488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 645/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:55.542043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.650423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fae3d5-197f-4b39-a779-a4dd5087fcf4 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.684729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.685369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.685646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.685920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.698072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.705225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:55.715064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:55.716101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:55.717176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:55.717176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:55.717176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:55.717176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 633/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:55.722128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.830022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d9edb-334a-473e-b931-d6018a3a6d3b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:55.871288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:55.871971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:55.872244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:55.872448 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:55.873131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:55.873438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:55.874826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:55.888578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 646/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:55.894442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:55.924994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:55.995961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c97ad-497c-4fa5-a834-92f42a913983 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.031181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.032267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.032267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.032444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.039921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.041498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 14:39:56.052929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:56.054042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:56.055944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 634/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:56.060584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.064558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:56.162128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c159a8d-550e-4479-9235-857791c1048b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.198541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.199180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.199452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.199714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.200430 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:56.200744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.202174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.220072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 647/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:56.226271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.321334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:56.332180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e939d5-b4bc-43f6-8802-f6af9e7846f1 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.382095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.383351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.383737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.384068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.452008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.453417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.564600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:56.575309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 635/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 14:39:56.581375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.645203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:56.685699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959e26a-01d3-4c5c-832a-f49e6fa0cc67 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.722638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.723184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.723458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.723724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.734556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.736025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 14:39:56.751769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:56.753651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 14:39:56.755899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 14:39:56.755899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 14:39:56.755899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:56.755899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 648/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:56.760763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:56.866075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3415b3b-7295-4f2b-93f0-fe889a8bacc6 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:56.902461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:56.903190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:56.903434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:56.903639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:56.904230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:56.904756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:56.907149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:56.920878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 636/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:56.927397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.033958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426b85-4364-475d-ae0d-b7bb08f2867b None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.048133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:57.068186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.068854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.069136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.069405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.077196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.078680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 14:39:57.095280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:57.097044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: ERROR keystone.server.flask.application Aug 24 14:39:57.099262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 649/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 24 14:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:57.105299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.159195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:57.212573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc28e3d-e468-4a50-aa5b-04ed983a129d None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.251491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.252156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.252997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.252997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.253424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:57.253864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.255316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ef38-2b7e-4c51-a3de-9211a4cdb852 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.268918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 637/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 24 14:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:39:57.276025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:57.381191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a517f81a-100c-4c01-9e33-8fb0d87ca2cb None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:57.418228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] RBAC: Adding query filter params (role.id=228b0dcdf849444fa0aff2d4bd2de87c, scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0, user.id=776bd34229a4419495ec77bd62fb9ea7) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:57.425873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52924b-6566-46f6-9b0f-07d780f95098 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:57.428342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 650/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 24 14:39:57 2022] GET /identity/v3/role_assignments?user.id=776bd34229a4419495ec77bd62fb9ea7&scope.project.id=9c5d7e2b381046af9424801ec7cd7ee0&role.id=228b0dcdf849444fa0aff2d4bd2de87c => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:39:59.405925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef1e4-604a-46e4-b715-2f3082a0547d None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:59.406456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef1e4-604a-46e4-b715-2f3082a0547d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:59.406456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ef1e4-604a-46e4-b715-2f3082a0547d None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:59.407854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 638/1288] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:39:59.413241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:59.419670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:59.419670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:59.431905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:39:59.433127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:39:59.464187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:59.513793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 651/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:39:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:39:59.799573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ef1e4-604a-46e4-b715-2f3082a0547d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:39:59.919900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ef1e4-604a-46e4-b715-2f3082a0547d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:39:59.933000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:39:59.964686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:39:59.965405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:39:59.965687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:39:59.965955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] PATH_INFO: `/v3/services/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:39:59.966543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:39:59.967920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:39:59.978495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:39:59.979680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:39:59.980563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 639/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:39:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:39:59.986015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:00.091284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f7d8e2-eced-4432-8e44-d490c7666265 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:00.126240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:00.126860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:00.127138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:00.127408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:00.128053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:00.128354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:00.129782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07604f5-69ba-4790-bc41-ae49f653448f None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:00.136336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 652/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 14:39:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:00.142569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:00.249303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59978-1b6d-4077-ab8f-83076de6b8ee None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:00.283973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:00.284579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:00.284884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:00.288128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] PATH_INFO: `/v3/services` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:00.288128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] RBAC: Adding query filter params (type=placement) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:00.288128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:00.288128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343052aa-01f4-4b08-b75e-023899be577b None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:00.292464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 640/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 14:40:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:02.255179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515192-d313-4983-9a10-e675f659cd54 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:02.255780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515192-d313-4983-9a10-e675f659cd54 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:02.255780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0515192-d313-4983-9a10-e675f659cd54 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:02.257086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 653/1293] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:40:02.263316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fa12-1616-4162-b8bb-5fc548f9cf52 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:02.268415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fa12-1616-4162-b8bb-5fc548f9cf52 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:02.268415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fa12-1616-4162-b8bb-5fc548f9cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:02.284489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b7f4fa12-1616-4162-b8bb-5fc548f9cf52 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:02.285711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b7f4fa12-1616-4162-b8bb-5fc548f9cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:02.315838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:02.362529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 641/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:40:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:40:02.633718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515192-d313-4983-9a10-e675f659cd54 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:02.667231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:02.741368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0515192-d313-4983-9a10-e675f659cd54 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:02.778124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:02.784417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:02.784417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:02.784417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:02.784417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:02.784417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0803131-3c1e-4d89-b6f1-42610daa3262 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:02.880332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 654/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 24 14:40:02 2022] POST /identity/v3/services => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:04.836200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece0db0-4cbf-4a30-89f8-abeace3d41f9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:04.836781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece0db0-4cbf-4a30-89f8-abeace3d41f9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:04.836781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece0db0-4cbf-4a30-89f8-abeace3d41f9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:04.838234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 642/1296] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:40:04.846832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:04.847329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:04.847528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:04.866513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:04.868518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:04.943332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 655/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:40:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:40:05.215991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece0db0-4cbf-4a30-89f8-abeace3d41f9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:05.335070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece0db0-4cbf-4a30-89f8-abeace3d41f9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:05.373778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:05.375033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:05.375299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:05.375563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:05.376191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:05.379189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:40:05.390008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:40:05.391411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:05.392594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 643/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:40:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:40:05.397260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:05.417242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:05.502250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9da1f-d9de-4d86-940d-952c52a4008c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:05.536985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:05.537343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:05.537674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:05.537942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:05.538602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:05.538908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:05.540303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:05.545894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 656/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 14:40:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:05.552081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:05.589127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:05.665878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622450e-d0e7-4cbf-85b5-5e0699841151 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:05.708262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:05.708906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:05.709189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:05.714643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:05.714643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] RBAC: Adding query filter params (interface=public, service_id=fd046978e20148d5be123d365b14c3ab, region_id=RegionOne) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:05.714643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:05.714643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2bd01-e6ca-4cd4-8b74-5986dc0cd775 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:05.717198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 644/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 24 14:40:05 2022] GET /identity/v3/endpoints?service_id=fd046978e20148d5be123d365b14c3ab&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:05.724899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:05.812375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:05.831489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef9ef9-4a62-4a28-a351-bd98a6c7f4f5 None admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:05.869125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:05.869795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:05.869987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:05.870254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:05.870851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:05.872214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca86ee8-1500-44a7-b898-33255005ba12 None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:05.879062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 657/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 24 14:40:05 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:40:07.823548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4846-2d80-4cd1-928b-c5717a8d7c46 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:07.824052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4846-2d80-4cd1-928b-c5717a8d7c46 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:07.824052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa4846-2d80-4cd1-928b-c5717a8d7c46 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:07.825427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 645/1302] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:40:07.830868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:07.832371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:07.832371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:07.850167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:40:07.851978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:40:07.921965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 658/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:40:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 14:40:08.194657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4846-2d80-4cd1-928b-c5717a8d7c46 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:08.295969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:08.302617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa4846-2d80-4cd1-928b-c5717a8d7c46 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:08.339871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:08.340695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:08.341001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:08.341267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:08.341844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:08.343296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 14:40:08.353415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 14:40:08.356166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application with Lock( Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self._enter() Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application return self.creator() Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application created_value = creator( Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: ERROR keystone.server.flask.application Aug 24 14:40:08.357268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 646/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 24 14:40:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 14:40:08.360854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:08.440596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:08.464555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5c2ce-0272-48f7-8632-5c3e78d59781 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:08.499764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] PATH_INFO: `/v3/services` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:08.505242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c15a5-3f4a-425a-b487-6f841addf58b None admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:08.508757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 659/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 24 14:40:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:40:08.514480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:40:08.619526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a8ae4-f8f7-4ffa-b51c-f4e2de2f2ca5 None admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:40:08.653224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:40:08.656644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:40:08.656644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:40:08.656644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:40:08.656644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:40:08.656644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1708ff-054b-42a4-aaa3-0f6734c8e0cf None admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:40:08.772200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 647/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:40:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:40:18.562194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=30 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:40:18.767293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:15.671740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54f5c-87ea-4149-9ecc-43f3a4ac697b None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:15.672327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54f5c-87ea-4149-9ecc-43f3a4ac697b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:15.672327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf54f5c-87ea-4149-9ecc-43f3a4ac697b None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:15.679042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765982f-695b-4e3d-be7d-a2071456bb4e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:15.679709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765982f-695b-4e3d-be7d-a2071456bb4e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:15.679709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765982f-695b-4e3d-be7d-a2071456bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:15.682516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 660/1307] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:15.773866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3765982f-695b-4e3d-be7d-a2071456bb4e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:15.775485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3765982f-695b-4e3d-be7d-a2071456bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:16.081673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 648/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:47:16.360272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:16.360545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:16.361082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:16.362646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 661/1309] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 24 14:47:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:16.369331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c658cd-65e5-492a-be31-2ecba9d6fffb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:16.369983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c658cd-65e5-492a-be31-2ecba9d6fffb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:16.370470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c658cd-65e5-492a-be31-2ecba9d6fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:16.460338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c8c658cd-65e5-492a-be31-2ecba9d6fffb None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:16.461588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c8c658cd-65e5-492a-be31-2ecba9d6fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:16.491377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:16.555022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 649/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 24 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:16.566456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:16.568228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:16.685481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ef95c-070a-49f7-8052-ca622886f72e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:16.762872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:16.763368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:16.763641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:16.763909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:16.766081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:16.822718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:16.890808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:16.892354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcadf57-ea0a-48be-97b9-76dada5df7c5 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:16.912807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 662/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:19.199261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:19.199815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:19.199815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:19.201131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 650/1312] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:19.208850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dceb-d0a1-469e-adb3-11c2b132258c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:19.209375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dceb-d0a1-469e-adb3-11c2b132258c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:19.209454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8dceb-d0a1-469e-adb3-11c2b132258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:19.299337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-14a8dceb-d0a1-469e-adb3-11c2b132258c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:19.300466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-14a8dceb-d0a1-469e-adb3-11c2b132258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:19.410184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 663/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:19.698484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:19.700156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:19.814832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ab111-c7d2-4fcd-a60e-73fe93893503 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:19.898150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:19.900961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:19.901583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:19.901862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:19.902133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:19.903784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:20.048021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:20.049455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3491-f6c8-4f48-9d11-6014bf3de293 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:20.070531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 651/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:22.568574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:22.578332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:22.578332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:22.578332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 664/1315] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:22.578674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d29d7-6e5b-4cbd-bcc9-e0aec4550cae None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:22.578674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d29d7-6e5b-4cbd-bcc9-e0aec4550cae None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:22.578674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d29d7-6e5b-4cbd-bcc9-e0aec4550cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:22.648067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e78d29d7-6e5b-4cbd-bcc9-e0aec4550cae None None] MFA Rules not processed for user `2f10a52cb2974b4d8984cb32416192fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:22.649256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e78d29d7-6e5b-4cbd-bcc9-e0aec4550cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:22.703703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:22.751929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 652/1316] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:23.041053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:23.042597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:23.052543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:23.149544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7214-ab0a-4c38-bd4a-dbff1fae1867 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:23.225527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:23.226185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:23.226456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:23.226719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:23.228386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:23.294560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:23.348114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:23.349601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eebbc-ce7f-41da-8ed0-96c2a6c654ef service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:23.368928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 665/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:26.145087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a927ba-74fd-4eb2-a199-5074a3d769e0 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:26.145642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a927ba-74fd-4eb2-a199-5074a3d769e0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:26.145642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a927ba-74fd-4eb2-a199-5074a3d769e0 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:26.146999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 653/1318] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:26.152616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf5c3-d1fb-474c-b51e-dcd3a9138019 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:26.153135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf5c3-d1fb-474c-b51e-dcd3a9138019 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:26.153232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bf5c3-d1fb-474c-b51e-dcd3a9138019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:26.227671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a18bf5c3-d1fb-474c-b51e-dcd3a9138019 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:26.228944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a18bf5c3-d1fb-474c-b51e-dcd3a9138019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:26.338305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 666/1319] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:26.642414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:26.642735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:26.643006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:26.644376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 654/1320] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 24 14:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:26.650611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2d1-c7e5-4973-9074-09b1e955355b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:26.650900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2d1-c7e5-4973-9074-09b1e955355b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:26.651177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa2d1-c7e5-4973-9074-09b1e955355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:26.675123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:26.735334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-319aa2d1-c7e5-4973-9074-09b1e955355b None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:26.736556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-319aa2d1-c7e5-4973-9074-09b1e955355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:26.817691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 667/1321] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 24 14:47:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:26.827000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:26.828525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:26.937729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72296fd-5073-448e-9b8d-a567d8d886c0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:27.017556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:27.018161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:27.018438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:27.018707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:27.020317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:27.028010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:27.132853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:27.134289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20616a43-ad79-4d14-859d-bcb736e0356b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:27.152418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 655/1322] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:30.598060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:30.598622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:30.598713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:30.600058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 668/1323] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:30.605937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef25c-4a6c-480e-9c2a-2176b00b5579 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:30.608346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef25c-4a6c-480e-9c2a-2176b00b5579 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:30.608346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daef25c-4a6c-480e-9c2a-2176b00b5579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:30.681493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9daef25c-4a6c-480e-9c2a-2176b00b5579 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:30.682723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9daef25c-4a6c-480e-9c2a-2176b00b5579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:30.745781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:30.788533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 656/1324] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:31.077158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:31.079121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:31.201269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e27f0-7616-404f-bc3c-c8486b65ef71 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:31.214238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:31.287572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:31.288175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:31.288443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:31.288738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:31.290337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:31.411653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:31.413187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f8df3-162e-4f6a-a18c-aaee976ed1b1 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:31.434236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 669/1325] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:33.526207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:33.526755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:33.527060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:33.530192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 657/1326] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:33.537663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf07cf-da24-4af8-8b56-e7922cfa3b73 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:33.538193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf07cf-da24-4af8-8b56-e7922cfa3b73 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:33.538193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf07cf-da24-4af8-8b56-e7922cfa3b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:33.602137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:33.624503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-aeaf07cf-da24-4af8-8b56-e7922cfa3b73 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:33.624503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-aeaf07cf-da24-4af8-8b56-e7922cfa3b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:33.730172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 670/1327] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:34.016030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:34.017590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:34.135080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592593e1-4b46-41d8-908c-c45397f5f8f3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:34.214130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:34.214732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:34.215005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:34.215274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:34.217019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:34.235510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:34.336610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:34.338117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6beaef-8522-47a0-bfdd-b76181fccc51 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:34.359394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 658/1328] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:36.366463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:36.367026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:36.367026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:36.371470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 671/1329] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:36.375731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2323-4593-4f0e-8d3c-ebb6c94d276d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:36.376456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2323-4593-4f0e-8d3c-ebb6c94d276d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:36.376456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad2323-4593-4f0e-8d3c-ebb6c94d276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:36.481736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-fcad2323-4593-4f0e-8d3c-ebb6c94d276d None None] MFA Rules not processed for user `2f10a52cb2974b4d8984cb32416192fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:36.482993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fcad2323-4593-4f0e-8d3c-ebb6c94d276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:36.555818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:36.595148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 659/1330] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:47:36.878809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:36.880340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:37.005378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557fbc1-99e4-4831-ae80-4cb8164db789 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:37.027168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:37.086334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:37.086944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:37.087225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:37.087489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:37.089131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:37.199003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:37.200379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04c6b1-697f-43f2-b3cb-2ebca6906fd3 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:37.220191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 672/1331] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:39.628667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:39.628667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:39.628667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:39.628667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 660/1332] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:39.633679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31835-ecd2-4743-a299-dfb129814ec9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:39.634120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31835-ecd2-4743-a299-dfb129814ec9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:39.634232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f31835-ecd2-4743-a299-dfb129814ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:39.706257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:39.709040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e4f31835-ecd2-4743-a299-dfb129814ec9 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:39.710271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e4f31835-ecd2-4743-a299-dfb129814ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:39.809681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 673/1333] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:40.094831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:40.096699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:40.239872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4720c-6d75-43b7-ae59-d457e80f31e6 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:40.322365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:40.322994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:40.323272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:40.323544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:40.325208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:40.368494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:40.471640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:40.473120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b0a81-7a3e-4595-9fdb-831bfa613d7e service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:40.493735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 661/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:42.493262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:42.493871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:42.493871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:42.495268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 674/1335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:42.503989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9caa82-34ee-4c24-a9b1-b3c317e68340 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:42.504514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9caa82-34ee-4c24-a9b1-b3c317e68340 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:42.504514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9caa82-34ee-4c24-a9b1-b3c317e68340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:42.574817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7b9caa82-34ee-4c24-a9b1-b3c317e68340 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:42.576908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7b9caa82-34ee-4c24-a9b1-b3c317e68340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:42.655626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:42.678545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 662/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:42.961805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:42.963346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:43.069785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301fe1c-d9dc-474a-b88e-ad4d43f2bc44 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:43.098952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:43.144416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:43.145071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:43.145347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:43.145614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:43.147204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:43.262998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:43.264651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03788750-1720-4ad8-b3ea-d12b83d167d6 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:43.284845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 675/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:45.793589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:45.794239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:45.794239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:45.795470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 663/1338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:45.800879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ce61-9923-4323-9568-d3151a0c4661 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:45.801302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ce61-9923-4323-9568-d3151a0c4661 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:45.801423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04ce61-9923-4323-9568-d3151a0c4661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:45.869876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5d04ce61-9923-4323-9568-d3151a0c4661 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:45.871102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5d04ce61-9923-4323-9568-d3151a0c4661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:45.880953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:45.973018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 676/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:46.271290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:46.272864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:46.379219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989991f2-74a9-48d5-b38d-1a089565ed74 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:46.471410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:46.471937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:46.472213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:46.472478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:46.474126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:46.513231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:46.587095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:46.588534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f54c0-e4a9-460b-9595-64a29d5bcbb4 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:46.608132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 664/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:50.775437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:50.775958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:50.776079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:50.777405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 677/1341] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:50.783167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b09b-8bb6-4349-b779-6071bbb4677d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:50.783629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b09b-8bb6-4349-b779-6071bbb4677d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:50.783733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616b09b-8bb6-4349-b779-6071bbb4677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:50.850062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c616b09b-8bb6-4349-b779-6071bbb4677d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:50.851284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c616b09b-8bb6-4349-b779-6071bbb4677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:50.953425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:50.965656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 665/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:51.251126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:51.252822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:51.382381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b270746-f82a-42ad-8258-697a5fe1c2bb None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:51.422643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:51.459626 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:51.460237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:51.460513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:51.460807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:51.463236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:51.584794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:51.586246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f9d03-081a-4ad8-b691-584fe0c1b9f8 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:51.606088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 678/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:47:54.568944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:54.569495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:54.569495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:54.570837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 666/1344] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:47:54.576791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75a10-f21c-4c0e-9451-d3bdd67b4fa0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:54.577195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75a10-f21c-4c0e-9451-d3bdd67b4fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:54.577336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def75a10-f21c-4c0e-9451-d3bdd67b4fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:54.649863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-def75a10-f21c-4c0e-9451-d3bdd67b4fa0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:47:54.651136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-def75a10-f21c-4c0e-9451-d3bdd67b4fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:54.673042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:54.754190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 679/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:47:55.042263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:47:55.044374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:55.179548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2574567-4c3c-4a6e-8098-77db9f4901bc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:47:55.260952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:47:55.261756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:47:55.262113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:47:55.262505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:47:55.265340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:47:55.327558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:47:55.401187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:47:55.402634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015c638-2fcf-477f-82af-8ab2aaf11906 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:47:55.421447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 667/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:00.067273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:00.067846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:00.067846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:00.069225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 680/1347] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:00.075545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0a29-6cbc-49a4-8eda-91f0e7df45b3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:00.076035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0a29-6cbc-49a4-8eda-91f0e7df45b3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:00.076035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f0a29-6cbc-49a4-8eda-91f0e7df45b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:00.147380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a98f0a29-6cbc-49a4-8eda-91f0e7df45b3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:00.148623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a98f0a29-6cbc-49a4-8eda-91f0e7df45b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:00.256020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:00.258604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 668/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:00.546505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:00.548030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:00.660525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367bd8e-f116-48fe-8179-0b5eec0a9739 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:00.713036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:00.740955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:00.741713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:00.742277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:00.742551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:00.744158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:00.852853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:00.854290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd90a3-bb83-444f-b6b7-617d490b54ae service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:00.872973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 681/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:05.894871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e15a-aaaa-4e99-9360-abd0ce89976f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:05.895381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e15a-aaaa-4e99-9360-abd0ce89976f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:05.895458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e15a-aaaa-4e99-9360-abd0ce89976f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:05.897005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 669/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:05.903197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faee14-486c-405b-a155-239997649727 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:05.904401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faee14-486c-405b-a155-239997649727 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:05.904968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faee14-486c-405b-a155-239997649727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:06.016563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-49faee14-486c-405b-a155-239997649727 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:06.018213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-49faee14-486c-405b-a155-239997649727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:06.049255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:06.229174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 682/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:10.696565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa0a2-e48e-43e0-b5a1-661ccf81ecc6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:10.697240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa0a2-e48e-43e0-b5a1-661ccf81ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:10.697240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa0a2-e48e-43e0-b5a1-661ccf81ecc6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:10.699969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 670/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:10.706435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0695-9f69-4224-847b-5503f7edd331 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:10.706435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0695-9f69-4224-847b-5503f7edd331 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:10.706435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf0695-9f69-4224-847b-5503f7edd331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:10.823084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9bdf0695-9f69-4224-847b-5503f7edd331 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:10.825843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9bdf0695-9f69-4224-847b-5503f7edd331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:10.909586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:10.958513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 683/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:12.357476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0e6-d267-4243-ae1d-bc6f0be4eee2 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:12.358019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0e6-d267-4243-ae1d-bc6f0be4eee2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:12.358289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0e6-d267-4243-ae1d-bc6f0be4eee2 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:12.359720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 671/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:12.365257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fef2b-0008-4d31-bbec-becae2b7a931 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:12.365744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fef2b-0008-4d31-bbec-becae2b7a931 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:12.365839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fef2b-0008-4d31-bbec-becae2b7a931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:12.452765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-343fef2b-0008-4d31-bbec-becae2b7a931 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:12.454251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-343fef2b-0008-4d31-bbec-becae2b7a931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:12.587086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 684/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:48:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:16.316046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaf066-4445-4921-a5e5-de1f789f58c6 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:16.316898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaf066-4445-4921-a5e5-de1f789f58c6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:16.319715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaf066-4445-4921-a5e5-de1f789f58c6 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:16.326617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 672/1356] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:16.342896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921a12-fd84-4b17-9c2e-e17f2f00a510 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:16.343321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921a12-fd84-4b17-9c2e-e17f2f00a510 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:16.345209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e921a12-fd84-4b17-9c2e-e17f2f00a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:16.392776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:16.460214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0e921a12-fd84-4b17-9c2e-e17f2f00a510 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:16.462960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0e921a12-fd84-4b17-9c2e-e17f2f00a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:16.622190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 685/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:16.934376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:16.935168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:16.935644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:16.937753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 673/1358] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 14:48:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:16.946385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac810-6797-4333-8db9-91ea109d2350 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:16.951285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac810-6797-4333-8db9-91ea109d2350 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:16.951285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ac810-6797-4333-8db9-91ea109d2350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:17.037030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7e2ac810-6797-4333-8db9-91ea109d2350 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:17.038455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7e2ac810-6797-4333-8db9-91ea109d2350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:17.109337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:17.194864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 686/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 14:48:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:17.203310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:17.204830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:17.371671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952417f-3d85-434e-bd5b-1db47d7013d8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:17.466306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:17.511914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:17.512524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:17.512825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:17.513095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:17.515147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:17.648759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:17.650449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d4c0d2-baac-40d0-8dc8-dec6081f1f44 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:17.672278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 674/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:19.935249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:19.935809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:19.935809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:19.937319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 687/1361] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:19.942496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da2aa-d35e-412d-8a7e-e73a90b8cc14 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:19.942933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da2aa-d35e-412d-8a7e-e73a90b8cc14 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:19.943088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5da2aa-d35e-412d-8a7e-e73a90b8cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:20.024359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-fb5da2aa-d35e-412d-8a7e-e73a90b8cc14 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:20.025778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fb5da2aa-d35e-412d-8a7e-e73a90b8cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:20.066729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:20.152761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 675/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:20.615885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:20.618213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:20.802467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f3db-b712-4981-a52e-3159f331e045 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:20.816278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:20.965721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:20.966420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:20.966776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:20.967113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:20.968841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:21.077204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:21.078845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cd7c0-f881-4311-b67f-64801d641865 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:21.098259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 688/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:23.722644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc962-96d1-429d-8573-d731c9d8037d None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:23.723436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc962-96d1-429d-8573-d731c9d8037d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:23.723579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099cc962-96d1-429d-8573-d731c9d8037d None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:23.725197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 676/1364] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:48:23.733299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd557-ce93-42af-ba55-74e577a06793 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:23.733799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd557-ce93-42af-ba55-74e577a06793 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:23.734152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd557-ce93-42af-ba55-74e577a06793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:23.760074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:23.841471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2e7dd557-ce93-42af-ba55-74e577a06793 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:23.843536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2e7dd557-ce93-42af-ba55-74e577a06793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:24.009830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 689/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:24.545970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:24.546232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:24.546499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:24.548837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 677/1366] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 14:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:24.556133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d063-985c-4d4b-9d58-86b0af2d02ae None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:24.556654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d063-985c-4d4b-9d58-86b0af2d02ae None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:24.557107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3d063-985c-4d4b-9d58-86b0af2d02ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:24.664359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f5d3d063-985c-4d4b-9d58-86b0af2d02ae None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:24.665572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f5d3d063-985c-4d4b-9d58-86b0af2d02ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:24.717326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:24.848753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 690/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:24.859939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:24.862270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:25.092035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c429db9d-c1f2-41ac-827f-2e1eaba98459 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:25.116296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:25.224445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:25.225085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:25.225360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:25.225626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:25.227258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:25.337412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:25.339026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7defb-92eb-4dfb-b52d-cb47a53099b6 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:25.359461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 678/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:25.964640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd7c2-5d9c-4480-8a12-0bb958eaf4b0 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:25.965413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd7c2-5d9c-4480-8a12-0bb958eaf4b0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:25.965413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd7c2-5d9c-4480-8a12-0bb958eaf4b0 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:25.966866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 691/1369] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:48:25.973388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d247685-1cc7-43f1-822c-cb54cf75d3ee None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:25.974147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d247685-1cc7-43f1-822c-cb54cf75d3ee None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:25.974147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d247685-1cc7-43f1-822c-cb54cf75d3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:26.010020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:26.056000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3d247685-1cc7-43f1-822c-cb54cf75d3ee None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:26.060146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3d247685-1cc7-43f1-822c-cb54cf75d3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:26.209089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 679/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:26.844403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:26.844818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:26.845012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:26.846930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 692/1371] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 24 14:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:48:26.852034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fcbd-2900-4807-983e-622ad0ad8a3c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:26.852324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fcbd-2900-4807-983e-622ad0ad8a3c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:26.852607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99fcbd-2900-4807-983e-622ad0ad8a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:26.986763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-bb99fcbd-2900-4807-983e-622ad0ad8a3c None None] MFA Rules not processed for user `4bb596b4e1074e5d85dec4ed71dc3052`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:26.989045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bb99fcbd-2900-4807-983e-622ad0ad8a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:27.069384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:27.139361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 680/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 24 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:27.153809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:27.157212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:27.367388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527c4c0-a690-40fb-944b-7b47de27aab5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:27.496565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:27.556561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:27.556561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:27.556561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:27.556561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:27.564736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:27.750718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:27.752479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:27.771573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642acd-4267-4424-ba0f-d2a0d37b0876 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:27.771985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642acd-4267-4424-ba0f-d2a0d37b0876 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:27.772433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642acd-4267-4424-ba0f-d2a0d37b0876 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:27.774964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 681/1373] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:48:27.779668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 693/1374] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:27.783539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7af79-9660-406f-8d30-32b9bec87d32 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:27.783904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7af79-9660-406f-8d30-32b9bec87d32 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:27.784187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7af79-9660-406f-8d30-32b9bec87d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:27.871141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c5b7af79-9660-406f-8d30-32b9bec87d32 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:27.872384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c5b7af79-9660-406f-8d30-32b9bec87d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:28.021860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 682/1375] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:28.362276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:28.363618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:28.458742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:28.502828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d762e-ebe9-40e7-9a0f-dc37266d74b3 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:28.649897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:28.650919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:28.651524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:28.651853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:28.653952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:28.751779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:28.763143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:28.764839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ccd6c-14f7-423c-ba7e-5eaa03239c66 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:28.794768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 694/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:31.056447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.056961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.057069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.058643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 683/1377] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:31.064442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8808-02d0-419c-bd6f-5c5b604dde20 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.065340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8808-02d0-419c-bd6f-5c5b604dde20 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.065340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c8808-02d0-419c-bd6f-5c5b604dde20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.145066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-563c8808-02d0-419c-bd6f-5c5b604dde20 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:31.146519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-563c8808-02d0-419c-bd6f-5c5b604dde20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:31.277655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 695/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:31.569567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:31.571091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:31.657877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:31.757782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c0757-651d-4456-91db-0f413edb93c5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:31.892590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:31.893240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:31.893564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:31.893876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:31.895541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:31.908207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:32.020288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:32.022511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1057d-75a9-4710-a757-56b42e49ff36 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:32.044305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 684/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:34.217569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:34.218142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:34.218142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:34.224095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 696/1380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:34.225924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e506-497e-4fd1-a859-fc8f8d444e64 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:34.226417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e506-497e-4fd1-a859-fc8f8d444e64 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:34.226502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de48e506-497e-4fd1-a859-fc8f8d444e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:34.312050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-de48e506-497e-4fd1-a859-fc8f8d444e64 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:34.313322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-de48e506-497e-4fd1-a859-fc8f8d444e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:34.426249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:34.444182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 685/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:34.742890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:34.744610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:34.831394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:34.928336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f487619-d263-4bdf-8d44-5ef9e70887c8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:35.062772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:35.063469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:35.063859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:35.064239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:35.071079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:35.109312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:35.195995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:35.197775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384303-044d-4ebe-9d1f-30b96a9290e9 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:35.220947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 697/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:37.422476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:37.423062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:37.423062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:37.424679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 686/1383] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:37.431567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fa24-91b1-4a2f-9f8d-d00023985e48 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:37.432135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fa24-91b1-4a2f-9f8d-d00023985e48 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:37.432135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fa24-91b1-4a2f-9f8d-d00023985e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:37.517916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4734fa24-91b1-4a2f-9f8d-d00023985e48 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:37.519326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4734fa24-91b1-4a2f-9f8d-d00023985e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:37.645134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:37.646391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 698/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:37.969562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:37.971367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:38.154048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e0dc5-b4df-4340-8a00-bb678a2faa13 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:38.233423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:38.301016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:38.301768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:38.302121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:38.302540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:38.304597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:38.408380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:38.410033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac892f-e721-475f-b198-2f1aea5afdb4 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:38.429396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 687/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:41.048682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:41.049251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:41.049380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:41.051184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 699/1386] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:41.057873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e500e-88d8-4e9e-ab35-760be53e000e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:41.058377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e500e-88d8-4e9e-ab35-760be53e000e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:41.058473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e500e-88d8-4e9e-ab35-760be53e000e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:41.130524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1b9e500e-88d8-4e9e-ab35-760be53e000e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:41.131764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1b9e500e-88d8-4e9e-ab35-760be53e000e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:41.162163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:41.255986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 688/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:41.606918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:41.608771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:41.848374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa8faa-9721-4929-b541-99fe57368597 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:41.953037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:42.008202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:42.009317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:42.010185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:42.010800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:42.013510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:42.137619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:42.139223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728728be-6621-4c92-94b4-413e721b5f00 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:42.158315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 700/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:43.989881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4782-3ccc-47c7-ba8a-f1ccb7f0b272 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:43.990476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4782-3ccc-47c7-ba8a-f1ccb7f0b272 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:43.990691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d4782-3ccc-47c7-ba8a-f1ccb7f0b272 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:43.992863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 689/1389] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:44.000392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b290-7588-40c8-9e74-d8c7cfea8b14 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.000950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b290-7588-40c8-9e74-d8c7cfea8b14 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.001034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5b290-7588-40c8-9e74-d8c7cfea8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.079271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-34c5b290-7588-40c8-9e74-d8c7cfea8b14 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:44.080728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-34c5b290-7588-40c8-9e74-d8c7cfea8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.120737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:44.187543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 701/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:44.309831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb84bf-f24d-4678-8566-88dfdfa6e599 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.310082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb84bf-f24d-4678-8566-88dfdfa6e599 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.310290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb84bf-f24d-4678-8566-88dfdfa6e599 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.311794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 690/1391] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:44.317152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409170-59ee-49cf-bbdd-f0ce719d8e24 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.317520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409170-59ee-49cf-bbdd-f0ce719d8e24 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.317760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75409170-59ee-49cf-bbdd-f0ce719d8e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.389802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-75409170-59ee-49cf-bbdd-f0ce719d8e24 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:44.391025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-75409170-59ee-49cf-bbdd-f0ce719d8e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.496042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.496335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.496614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.498070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 702/1392] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:44.498223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 691/1393] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 24 14:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:48:44.503570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.503892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.504307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.524307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:44.580987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] MFA Rules not processed for user `ae76bbd0c6b34ed996bc76c1f4a00e27`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:44.582197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.662450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 703/1394] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 24 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:48:44.671462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:44.673076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.784681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0552b-9684-4d33-91eb-5b12ecb30107 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:44.792165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:44.793561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.843523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:44.867832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:44.881351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:44.881351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:44.881351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:44.881351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:44.928592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:44.940474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3baabc-c62f-4fe6-9e57-d7f836850d5c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:44.990323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:44.991798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86eb4e-997e-4fde-8ed5-963447ea1c5b service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:45.012329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 692/1395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:45.079644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:45.080244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:45.080518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:45.080822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:45.082483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:45.180242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:45.181914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63f84a-44b2-4b6c-a12b-0fbbb37ac236 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:45.196642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:45.202682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 704/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:48:45.962124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f0c9-e8a3-469d-b07d-a2123ca2752b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:45.965142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f0c9-e8a3-469d-b07d-a2123ca2752b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:45.965142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc0f0c9-e8a3-469d-b07d-a2123ca2752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:46.033834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-dcc0f0c9-e8a3-469d-b07d-a2123ca2752b None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:46.035037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dcc0f0c9-e8a3-469d-b07d-a2123ca2752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:46.071201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:46.125692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 693/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:46.173414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:46.173910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:46.174127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:46.175725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 705/1398] 10.222.0.47 () {54 vars in 943 bytes} [Wed Aug 24 14:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:46.182731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af8b6-631c-4e62-98db-bc9b0359c937 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:46.183087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af8b6-631c-4e62-98db-bc9b0359c937 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:46.183433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1af8b6-631c-4e62-98db-bc9b0359c937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:46.262391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0f1af8b6-631c-4e62-98db-bc9b0359c937 None None] MFA Rules not processed for user `3fb72c42601649fe866653918ccbb6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:46.263510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0f1af8b6-631c-4e62-98db-bc9b0359c937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:46.376364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 694/1399] 10.222.0.47 () {58 vars in 1040 bytes} [Wed Aug 24 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:46.386714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:46.388234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:46.540493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f567fb6-7802-43c1-8bcd-5f1e32991da2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:46.638188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:46.664736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:46.668940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:46.668940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:46.668940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:46.668940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:46.756402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:46.758127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3880a-4046-4785-b59b-a871d5c04415 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:46.766425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 706/1400] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:48:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:48:47.391964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:47.392505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:47.392774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:47.394664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 695/1401] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:47.400498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df09b-426b-4f33-bc04-1f1957806e85 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:47.401813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df09b-426b-4f33-bc04-1f1957806e85 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:47.401813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df09b-426b-4f33-bc04-1f1957806e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:47.488092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0b3df09b-426b-4f33-bc04-1f1957806e85 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:47.489458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0b3df09b-426b-4f33-bc04-1f1957806e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:47.607542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:47.644475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 707/1402] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:47.953481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:47.955145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:47.965826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:48.150037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690bce6-bc33-4d95-998a-01862c0dcb23 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:48.270896 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:48.323352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:48.323352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:48.323352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:48.323352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:48.324392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:48.454724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:48.457677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be346f8-6662-40ce-86a6-d841ea477d0c service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:48.480866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 696/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:51.668679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187445a3-6f25-42dc-8382-677b31710466 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:51.669891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187445a3-6f25-42dc-8382-677b31710466 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:51.670362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187445a3-6f25-42dc-8382-677b31710466 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:51.671734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 708/1404] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:51.677125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbbaa-4250-469b-8db9-eafcc04fe350 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:51.677557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbbaa-4250-469b-8db9-eafcc04fe350 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:51.677711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbbaa-4250-469b-8db9-eafcc04fe350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:51.757915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a8ddbbaa-4250-469b-8db9-eafcc04fe350 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:51.759168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a8ddbbaa-4250-469b-8db9-eafcc04fe350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:51.812946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:51.889332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 697/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:52.196070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187445a3-6f25-42dc-8382-677b31710466 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:52.197853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-187445a3-6f25-42dc-8382-677b31710466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:52.380907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187445a3-6f25-42dc-8382-677b31710466 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:52.441388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:52.510221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:52.511123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:52.511475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:52.511818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:52.513596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:52.614594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:52.616343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973a8e1-59bc-4b8e-8ab8-706725fb395a service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:52.639568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 709/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:48:54.823567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:54.824099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:54.824099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:54.825381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 698/1407] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:48:54.830820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad640-2af3-4040-bb55-02ef963f5e5f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:54.831246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad640-2af3-4040-bb55-02ef963f5e5f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:54.831361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ad640-2af3-4040-bb55-02ef963f5e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:54.907270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-339ad640-2af3-4040-bb55-02ef963f5e5f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:48:54.908586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-339ad640-2af3-4040-bb55-02ef963f5e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:54.923692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:55.016922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 710/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:48:55.311857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:48:55.313441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:55.506203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2dbd0-4769-4e01-9130-44bd9be5249a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:48:55.538455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:48:55.645425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:48:55.646029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:48:55.646303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:48:55.646566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:48:55.648188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:48:55.751036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:48:55.752757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b44fa-b0d3-42a6-9eef-e053694a8f80 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:48:55.774435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 699/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:05.014919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=38 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:05.771765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:12.008835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87414-ca8a-481d-bc43-e87039d89037 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:12.009473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87414-ca8a-481d-bc43-e87039d89037 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:12.009473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87414-ca8a-481d-bc43-e87039d89037 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:12.010719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 711/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 24 14:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:12.016436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11a19-ede7-421d-ae64-d86091b0f2a9 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:12.017083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11a19-ede7-421d-ae64-d86091b0f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:12.017251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a11a19-ede7-421d-ae64-d86091b0f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:12.099138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-36a11a19-ede7-421d-ae64-d86091b0f2a9 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:12.100375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-36a11a19-ede7-421d-ae64-d86091b0f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:12.209335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 700/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:49:12.225128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977839ff-9fbf-4d86-a518-2128d8b065a2 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:12.225520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977839ff-9fbf-4d86-a518-2128d8b065a2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:12.225999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977839ff-9fbf-4d86-a518-2128d8b065a2 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:12.227760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 712/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 24 14:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:12.233682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8c46-6d09-48db-a582-066b2b86fc50 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:12.234080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8c46-6d09-48db-a582-066b2b86fc50 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:12.234445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d8c46-6d09-48db-a582-066b2b86fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:12.313120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:12.315725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6c6d8c46-6d09-48db-a582-066b2b86fc50 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:12.316999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6c6d8c46-6d09-48db-a582-066b2b86fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:12.453583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 701/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:14.932945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:14.933517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:14.933517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:14.934799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:14.940961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376cb49-91a4-490b-91b9-152d050c675e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:14.941494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376cb49-91a4-490b-91b9-152d050c675e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:14.941494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376cb49-91a4-490b-91b9-152d050c675e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:15.128428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7376cb49-91a4-490b-91b9-152d050c675e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:15.129705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7376cb49-91a4-490b-91b9-152d050c675e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:15.186870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:15.229480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:15.520917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:15.522934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:15.700667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc69825-3059-4b1a-97db-2f255cecfaab None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:15.780080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:15.827884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:15.828502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:15.828788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:15.829061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:15.830659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:15.931449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:15.934778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b33711-c603-44b8-9c65-230a40aafc5e service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:15.954131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 714/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:16.872424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:16.873024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:16.873024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:16.874635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:16.879622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b4de-26bd-4c80-91a2-ac7813e4589c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:16.879907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b4de-26bd-4c80-91a2-ac7813e4589c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:16.880181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293b4de-26bd-4c80-91a2-ac7813e4589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:16.955852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d293b4de-26bd-4c80-91a2-ac7813e4589c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:16.957108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d293b4de-26bd-4c80-91a2-ac7813e4589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:16.984887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:17.054472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:17.246963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:17.248377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:17.401513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f409231-662c-41ed-9f3e-ebcba65fe12c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:17.454898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:17.540927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:17.542041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:17.542317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:17.542586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:17.544558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:17.662123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:17.664141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14322f-ba36-45f9-b26f-a3882fa4c124 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:17.686105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 704/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:18.585852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:18.586706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:18.586706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:18.587838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:18.594062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896bd7e-16cf-44d0-a26f-dcae73c3f9f1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:18.594609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896bd7e-16cf-44d0-a26f-dcae73c3f9f1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:18.594609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896bd7e-16cf-44d0-a26f-dcae73c3f9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:18.650043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:18.672362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6896bd7e-16cf-44d0-a26f-dcae73c3f9f1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:18.673590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6896bd7e-16cf-44d0-a26f-dcae73c3f9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:18.779960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:18.941638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:18.943494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:19.115887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f07ca-afb6-489d-80b2-72cf8e681dd7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:19.128897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:19.237141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:19.237665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:19.237943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:19.238212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:19.239829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:19.335473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:19.337133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a707-cc10-4d4e-92fb-d7f1ad494ade service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:19.355371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 717/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:20.245973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:20.246515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:20.246515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:20.248067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:20.253675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28782b-b40b-4f4b-8ba3-fae562e832eb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:20.254145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28782b-b40b-4f4b-8ba3-fae562e832eb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:20.254272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28782b-b40b-4f4b-8ba3-fae562e832eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:20.274634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:20.330671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2a28782b-b40b-4f4b-8ba3-fae562e832eb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:20.331905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2a28782b-b40b-4f4b-8ba3-fae562e832eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:20.437309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:20.587030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:20.588726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:20.708298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:20.744091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f8ac3-04bd-4626-a506-d510c2b4666c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:20.870288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:20.870773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:20.871043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:20.871306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:20.872935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:20.953876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:20.968492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:20.970128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e676480-afa9-46fe-b200-32cb4791aff9 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:20.989394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 707/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:21.874480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:21.875370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:21.875665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:21.877063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:21.882665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee48f-3bc7-4f9c-b355-7a02a606d620 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:21.883177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee48f-3bc7-4f9c-b355-7a02a606d620 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:21.883363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dee48f-3bc7-4f9c-b355-7a02a606d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:21.972512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d1dee48f-3bc7-4f9c-b355-7a02a606d620 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:21.973776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d1dee48f-3bc7-4f9c-b355-7a02a606d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:22.075211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:49:22.230320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:22.232545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:22.324190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:22.395930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8a832-072f-4c87-8d13-b1a36b932e95 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:22.520520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:22.521191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:22.521548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:22.521897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:22.523901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:22.593673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:22.642311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:22.643936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de36f-1f06-4b58-934f-29c5d3232da7 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:22.662215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 720/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:23.554224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:23.554803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:23.554803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:23.556107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:23.561857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48131-351a-4448-ace0-13d3dc76f062 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:23.562446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48131-351a-4448-ace0-13d3dc76f062 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:23.562446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af48131-351a-4448-ace0-13d3dc76f062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:23.646603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2af48131-351a-4448-ace0-13d3dc76f062 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:23.647836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2af48131-351a-4448-ace0-13d3dc76f062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:23.752813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:23.906021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:23.907456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:23.959048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:24.066036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67b6ea-5d46-40a4-ad42-98e53514b12e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:24.186340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:24.187015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:24.187358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:24.187654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:24.189496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:24.196694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:24.287767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:24.289626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287558c4-b96d-41b9-a10a-e9c344b15d04 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:24.311827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 710/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:25.182440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:25.183022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:25.183022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:25.184347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:25.190472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953af9-3e44-406d-bcde-7d541c9950d2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:25.190900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953af9-3e44-406d-bcde-7d541c9950d2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:25.191018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5953af9-3e44-406d-bcde-7d541c9950d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:25.270499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f5953af9-3e44-406d-bcde-7d541c9950d2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:25.271708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f5953af9-3e44-406d-bcde-7d541c9950d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:25.340611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:25.370499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:25.525492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:25.526945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:25.544508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:25.677021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8c72-3343-4967-bdf6-4967d15e01f0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:25.773870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:25.801588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:25.802123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:25.802398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:25.802668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:25.804269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:25.897810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:25.899402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af219cd6-c625-4ae8-b07e-c035ad48aab0 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:25.917941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 723/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:26.877709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:26.878279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:26.878279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:26.879684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:26.884902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca315412-7d20-4c28-9072-29df023f7bce None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:26.885330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca315412-7d20-4c28-9072-29df023f7bce None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:26.885425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca315412-7d20-4c28-9072-29df023f7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:26.962714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ca315412-7d20-4c28-9072-29df023f7bce None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:26.963864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ca315412-7d20-4c28-9072-29df023f7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:27.008940 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.066921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:27.240017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:27.241759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:27.400503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c89843-724b-4d14-9eb4-9550fa1dfb55 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:27.457218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:27.523532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:27.524172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:27.524515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:27.524815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:27.526412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:27.627051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:27.628644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b6c3c4-55ef-438e-99f3-a8806698abcd service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:27.647355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 713/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:28.561555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:28.562100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:28.562331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:28.563749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:28.569209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da1fc-771f-4dde-a0cd-358201ba6dde None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:28.569725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da1fc-771f-4dde-a0cd-358201ba6dde None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:28.569725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4da1fc-771f-4dde-a0cd-358201ba6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:28.649992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ec4da1fc-771f-4dde-a0cd-358201ba6dde None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:28.651127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ec4da1fc-771f-4dde-a0cd-358201ba6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:28.653270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:28.753164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:28.903879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:28.905362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:29.054089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c0bd-12fc-415f-ba44-5fb8c3176d2c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:29.081901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:29.170538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:29.171043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:29.171316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:29.171582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:29.173257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:29.265162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:29.266763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153469-bcb3-43bb-8d15-557e3099ab44 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:29.284982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 726/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:31.132680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:31.133318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:31.133318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:31.134585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:31.140922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfe76-b66d-4c34-945d-e6aea2fa81c2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:31.141443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfe76-b66d-4c34-945d-e6aea2fa81c2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:31.141443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cfe76-b66d-4c34-945d-e6aea2fa81c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:31.183923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:31.211439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-402cfe76-b66d-4c34-945d-e6aea2fa81c2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:31.212860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-402cfe76-b66d-4c34-945d-e6aea2fa81c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:31.315665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:31.601020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:31.602571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:31.713666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f1de7-d468-4db9-8e0a-72776754eafc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:31.748828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:31.791718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:31.792327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:31.792599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:31.792894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:31.795154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:31.926402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:31.928101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524aa9b-203f-45a5-9a04-c3a5a64fd9d8 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:31.946918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 716/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:34.083275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:34.083859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:34.083859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:34.085188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:34.090641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694ec-d2fd-4968-a6f3-667a3a5195f5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:34.091062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694ec-d2fd-4968-a6f3-667a3a5195f5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:34.091223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441694ec-d2fd-4968-a6f3-667a3a5195f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:34.157991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-441694ec-d2fd-4968-a6f3-667a3a5195f5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:34.159196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-441694ec-d2fd-4968-a6f3-667a3a5195f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:34.172702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:34.258116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:34.547426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:34.549017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:34.657113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed297-f8cf-401b-a9e8-14d1199f3aab None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:34.670241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:34.739757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:34.740396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:34.740671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:34.740990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:34.742651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:34.860976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:34.862492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0ccd-cb37-4a25-a55c-f26147c65297 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:34.881932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 729/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:37.410414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:37.410958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:37.410958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:37.412601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:37.417918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfdfa-6a2f-4a4a-9ec4-2727b71c7618 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:37.418372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfdfa-6a2f-4a4a-9ec4-2727b71c7618 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:37.418479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dfdfa-6a2f-4a4a-9ec4-2727b71c7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:37.473579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:37.492163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f89dfdfa-6a2f-4a4a-9ec4-2727b71c7618 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:37.493420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f89dfdfa-6a2f-4a4a-9ec4-2727b71c7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:37.592129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:37.898202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:37.899750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:38.007726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0dace-2192-47a7-8287-21645a54fc86 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:38.050810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:38.088788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:38.089585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:38.090068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:38.090540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:38.093607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:38.237144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:38.238481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5c73-cb3f-4c1d-90a5-ee4af289f9f4 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:38.261334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 719/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:49:40.459671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:40.460202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:40.460202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:40.461633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:40.468081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1bbe-64a2-44a7-8bc2-4d66eb0d4dce None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:40.468536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1bbe-64a2-44a7-8bc2-4d66eb0d4dce None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:40.468642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bf1bbe-64a2-44a7-8bc2-4d66eb0d4dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:40.538758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-33bf1bbe-64a2-44a7-8bc2-4d66eb0d4dce None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:40.540015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-33bf1bbe-64a2-44a7-8bc2-4d66eb0d4dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:40.560283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:40.637010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:40.926654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:40.928344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:41.036512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278b7f0-4663-4660-9d1e-bc962f27ae02 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:41.056433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:41.114497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:41.115108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:41.115386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:41.115658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:41.117318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:41.228768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:41.230136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d84c48-967b-4992-ae18-114e34c7d3e7 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:41.249197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 732/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:43.252698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:43.253316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:43.253316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:43.254630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:43.260254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece9b0-0000-452b-932f-2da204e94a42 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:43.260658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece9b0-0000-452b-932f-2da204e94a42 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:43.260866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece9b0-0000-452b-932f-2da204e94a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:43.325929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:43.329105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-95ece9b0-0000-452b-932f-2da204e94a42 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:43.330299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-95ece9b0-0000-452b-932f-2da204e94a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:43.432017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:43.727581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:43.729211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:43.837543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13254fc-0485-46d7-8b84-77d324c196cb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:43.889541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:43.915581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:43.916208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:43.916491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:43.916796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:43.918432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:44.047439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:44.048842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785f37-601b-4be9-80d3-ff5a61d624eb service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:44.068833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 722/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:46.062543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:46.063128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:46.063406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:46.065168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:46.070744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e46d7-13d4-45a3-85b7-eceac6bf3ba2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:46.071279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e46d7-13d4-45a3-85b7-eceac6bf3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:46.071382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e46d7-13d4-45a3-85b7-eceac6bf3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:46.142807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-886e46d7-13d4-45a3-85b7-eceac6bf3ba2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:46.144038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-886e46d7-13d4-45a3-85b7-eceac6bf3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:46.175305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:46.245345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:46.535996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:46.537606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:46.643287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48a63-8b37-41c9-8a23-ab048fb028f1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:46.674384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:46.721952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:46.722558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:46.722833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:46.723098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:46.724794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:46.835471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:46.836957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a68f16-6c0c-40c1-83be-bfa841dfbb6c service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:46.856957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 735/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:48.866601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:48.867182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:48.867182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:48.868481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:49:48.874806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9748-b4c9-484c-a5db-b8785b7f7d56 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:48.875249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9748-b4c9-484c-a5db-b8785b7f7d56 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:48.875379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9748-b4c9-484c-a5db-b8785b7f7d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:48.944990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-875d9748-b4c9-484c-a5db-b8785b7f7d56 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:48.946223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-875d9748-b4c9-484c-a5db-b8785b7f7d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:48.955260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:49.047140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:49.335838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:49.337410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:49.446528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d65a-2b14-48e6-87ef-b4f90e929d3b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:49.504866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:49.525372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:49.526028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:49.526337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:49.526642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:49.529013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:49.640941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:49.642437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08859a13-e45c-4a55-837d-3ce621fb8707 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:49.662470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 725/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:51.666944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:51.667577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:51.667577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:51.669507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:51.675250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292408-999e-4ab6-9c7c-4ebde76a1569 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:51.675815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292408-999e-4ab6-9c7c-4ebde76a1569 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:51.675815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292408-999e-4ab6-9c7c-4ebde76a1569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:51.761509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a1292408-999e-4ab6-9c7c-4ebde76a1569 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:51.763591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a1292408-999e-4ab6-9c7c-4ebde76a1569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:51.805993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:51.874048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:49:52.171112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:52.172666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:52.282223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9143769-f614-4489-9e48-58826bfb88c7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:52.325238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:52.364350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:52.366146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:52.366146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:52.366146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:52.367227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:52.487973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:52.489369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b8bbea-0e45-4d87-8d0c-fc853921ee1c service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:52.509136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 738/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:54.542260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:54.543123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:54.543123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:54.544339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:49:54.550282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9ef0-c5e0-404a-8fcb-7707c7cd5d84 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:54.551049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9ef0-c5e0-404a-8fcb-7707c7cd5d84 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:54.551246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc9ef0-c5e0-404a-8fcb-7707c7cd5d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:54.625453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-dcbc9ef0-c5e0-404a-8fcb-7707c7cd5d84 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:54.626682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dcbc9ef0-c5e0-404a-8fcb-7707c7cd5d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:54.645867 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:54.729644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:49:55.015181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:55.017003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:55.126000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd428d-45ec-4db7-a4f8-f06d727a3313 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:55.197116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:55.204010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:55.204616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:55.204936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:55.205195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:55.206824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:55.321333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:55.322682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2280b3-c465-46f2-b06b-d67819a58606 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:55.343468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 728/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:49:57.301628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:57.302217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:57.302217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:57.303507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:49:57.309065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683973-26fd-4e9b-9e8f-d10ff18b0717 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:57.309688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683973-26fd-4e9b-9e8f-d10ff18b0717 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:57.309688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683973-26fd-4e9b-9e8f-d10ff18b0717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:57.379462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-68683973-26fd-4e9b-9e8f-d10ff18b0717 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:49:57.380746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-68683973-26fd-4e9b-9e8f-d10ff18b0717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:57.431243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:57.482503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:49:57.764457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:49:57.766176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:57.876992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fa9c4-9efc-42ea-95b0-5c9d9fdec044 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:49:57.927181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:49:57.955018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:49:57.955625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:49:57.955898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:49:57.956168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:49:57.957826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:49:58.070912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:49:58.072644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f58e6-40ec-484f-b9e2-2b47fe605027 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:49:58.091968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 741/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:07.480066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=22 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:08.089522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=66 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:18.641858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b38d3-647f-4f33-95bb-e29b4692a509 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.642416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b38d3-647f-4f33-95bb-e29b4692a509 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.642416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b38d3-647f-4f33-95bb-e29b4692a509 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.643672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 730/1471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:18.648870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ab3a-e8d8-48aa-926b-b38c7edca87e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:18.649323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ab3a-e8d8-48aa-926b-b38c7edca87e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:18.649449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34ab3a-e8d8-48aa-926b-b38c7edca87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:18.715889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0b34ab3a-e8d8-48aa-926b-b38c7edca87e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:18.717127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0b34ab3a-e8d8-48aa-926b-b38c7edca87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:18.813387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 742/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:19.112136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:19.112414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:19.112732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:19.114105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 731/1473] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 24 14:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:19.118847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b068-dc7f-43f7-b4cb-2bceacf6b131 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:19.119136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b068-dc7f-43f7-b4cb-2bceacf6b131 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:19.119410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36b068-dc7f-43f7-b4cb-2bceacf6b131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:19.195811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ba36b068-dc7f-43f7-b4cb-2bceacf6b131 None None] MFA Rules not processed for user `ae76bbd0c6b34ed996bc76c1f4a00e27`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:19.197072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ba36b068-dc7f-43f7-b4cb-2bceacf6b131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:19.218250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:19.274305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 743/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 24 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:19.281895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:19.283416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:19.396313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d0a87-0e06-44d9-ab3a-f79bb32b162b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:19.470422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:19.471271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:19.471546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:19.471966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:19.473577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:19.528082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:19.588491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:19.590183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627209ce-8e97-4001-856d-0660452695e3 service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:19.610002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 732/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:21.637877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.638401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.638401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.639751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 744/1476] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:21.645082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71341-06a9-4c19-9f4d-eb177338f86b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:21.645529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71341-06a9-4c19-9f4d-eb177338f86b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:21.645644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71341-06a9-4c19-9f4d-eb177338f86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:21.715915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-13c71341-06a9-4c19-9f4d-eb177338f86b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:21.719607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-13c71341-06a9-4c19-9f4d-eb177338f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:21.849816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 733/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:22.141506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:22.143038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:22.271727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f01a2-c37c-4cbf-8c2d-5089e0c0ea21 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:22.321185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:22.367321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:22.367931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:22.368207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:22.368554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:22.369142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:22.372066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:50:22.372066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:50:22.372066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:50:22.373806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60223d-29d4-4e92-9d6a-0800b1980dcb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:22.400333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 745/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 24 14:50:22 2022] GET /identity/v3/projects => generated 2553 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:50:24.374781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:24.375362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:24.375362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:24.376726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 734/1479] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:24.382192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe1ea-96c2-43fe-a23e-eda0a00eaad8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:24.382568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe1ea-96c2-43fe-a23e-eda0a00eaad8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:24.382741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fe1ea-96c2-43fe-a23e-eda0a00eaad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:24.458051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-734fe1ea-96c2-43fe-a23e-eda0a00eaad8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:24.459275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-734fe1ea-96c2-43fe-a23e-eda0a00eaad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:24.555380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 746/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:24.856499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:24.858048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:24.867755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:25.014319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d9233-3273-4cb6-a91b-cd163a54fee9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:25.096177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:25.137090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:25.137702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:25.137982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:25.138253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:25.139873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:25.252607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:25.256291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf169ff-67dd-48c8-854b-8d7f190635bb service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:25.276022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 735/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:27.477555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:27.478108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:27.478108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:27.479467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 747/1482] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:27.485083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5db5-2538-4d63-961c-e8fe5ec2b0b2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:27.485557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5db5-2538-4d63-961c-e8fe5ec2b0b2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:27.485668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5db5-2538-4d63-961c-e8fe5ec2b0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:27.552475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cb6a5db5-2538-4d63-961c-e8fe5ec2b0b2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:27.553750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb6a5db5-2538-4d63-961c-e8fe5ec2b0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:27.601129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:27.650848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 736/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:27.962541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:27.964581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:27.990178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:28.191491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324675d-4dd4-4c32-a8c9-3cdddddbb558 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:28.266843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:28.267362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:28.267639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:28.267980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:28.269629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:28.350318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:28.387595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:28.389145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34790f17-c6ad-4294-a4ff-67fd50b50ae2 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:28.407939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 748/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:30.390671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:30.391138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:30.391232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:30.392561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 737/1485] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:30.397954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bded-5294-4976-a382-a9f9f9caad76 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:30.398407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bded-5294-4976-a382-a9f9f9caad76 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:30.398508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669bded-5294-4976-a382-a9f9f9caad76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:30.468269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8669bded-5294-4976-a382-a9f9f9caad76 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:30.469544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8669bded-5294-4976-a382-a9f9f9caad76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:30.565254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 749/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:50:30.852161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:30.853729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:30.960545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44892ec3-28ab-4363-b0f5-52fcecab40b8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:31.033657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:31.035494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:31.036103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:31.036381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:31.036653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:31.038317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:31.154451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:31.155804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f475-d07b-408d-8eb8-3e87483c23b6 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:31.178045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 738/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:33.197656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.198825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.198825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.200086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 750/1488] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:33.205528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77e23-0833-456a-9ac7-2c958fca11d1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.205932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77e23-0833-456a-9ac7-2c958fca11d1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.206067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f77e23-0833-456a-9ac7-2c958fca11d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.271832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-16f77e23-0833-456a-9ac7-2c958fca11d1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:33.273070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-16f77e23-0833-456a-9ac7-2c958fca11d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:33.326751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:33.372198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 739/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:33.663623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:33.665188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:33.702192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:33.774971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36394aa6-638f-46c6-a852-7de95b5ac7c5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:33.848469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:33.849096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:33.849366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:33.849632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:33.851435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:33.934044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:33.962719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:33.964188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a96544-6c43-4777-a2ea-166ca8ded1c1 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:33.982547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 751/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:50:36.358659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.359236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.359236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.360649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 740/1491] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 24 14:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:50:36.366530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0f18-e318-4a36-8173-e3ff057e236b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:36.366530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0f18-e318-4a36-8173-e3ff057e236b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:36.368104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a0f18-e318-4a36-8173-e3ff057e236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:36.441839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-237a0f18-e318-4a36-8173-e3ff057e236b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:50:36.443060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-237a0f18-e318-4a36-8173-e3ff057e236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.547142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 752/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 24 14:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:50:36.839762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:50:36.841351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:36.953079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d0ca7-f46c-4e77-a0fa-2e68b762a7a8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:50:37.028700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:50:37.029328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:50:37.029605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:50:37.029876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:50:37.031479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:50:37.042611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:37.143565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:50:37.144947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d32faf-1963-4af6-9244-3a0958180f0d service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:50:37.163133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 741/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:50:46.545285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=82 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:50:47.160948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=50 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:58.954430 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:58.954997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:58.954997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:59.029718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:59.030914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:59.126372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 753/1494] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:59.134554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:59.135051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:59.135170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:59.210220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:51:59.211425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:59.308039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 742/1495] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:51:59.312762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:59.313959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:59.325629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3818e3-c6a1-407c-9aa9-135212e730e7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:59.388136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:59.423162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:59.423763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:59.424051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:59.424298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:59.424970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:51:59.425268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:59.426286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:51:59.426286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:51:59.426286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:51:59.427173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:59.439203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 754/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:51:59.447576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:59.457832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a464bd5-688d-4f0e-a22a-f33b03149208 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:59.528291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:51:59.569897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:59.570531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:59.570807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:59.571075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:59.571700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:59.573958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:51:59.573958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:51:59.573958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:51:59.575166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:59.699360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 743/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:51:59 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:59.703732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:59.705326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:51:59.740248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba2fc6-04c6-4079-a733-084945d99e2e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:51:59.856155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:51:59.856810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:51:59.857086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:51:59.857415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:51:59.858045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:51:59.860015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:51:59.860015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:51:59.860015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:51:59.861264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:51:59.955861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 755/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:51:59 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:51:59.959963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:51:59.961521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.028522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581cbdc-0f44-436c-88c3-1ee60495279d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:00.111753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:00.123000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:00.123942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.124311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.124731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.125731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:00.127333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:52:00.127333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:52:00.127333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:52:00.128846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:00.149273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 744/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:00.153955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:00.156021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.168433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ea363-2a44-4019-bde9-c6ea2fc8cb4c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:00.195865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:00.271920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:00.272461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.272759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.273026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.273665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:00.274688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:52:00.274688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:52:00.274688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:52:00.275571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153907b-1b1f-4fbe-9119-d287c43b5756 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:00.290137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 756/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:52:00.294572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:00.295971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.331771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ced2d3-69ef-414a-9828-f130b63f7936 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:00.427973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:00.428635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.428937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.429206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] PATH_INFO: `/v3/projects/af347d60e91b4aa3ac8bd333d97115c4/users/9f949a3ceab34990812bd60d2e1258f9/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.453317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af347d60e91b4aa3ac8bd333d97115c4, user_id=9f949a3ceab34990812bd60d2e1258f9, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:00.454344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:52:00.454344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:52:00.454344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:52:00.456309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6b2e1-3ab8-4a43-8706-8de8c58fdb67 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:00.554939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 745/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:52:00 2022] PUT /identity/v3/projects/af347d60e91b4aa3ac8bd333d97115c4/users/9f949a3ceab34990812bd60d2e1258f9/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:00.567689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6146-20d9-437a-964f-6ccb0c5620c1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.567978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6146-20d9-437a-964f-6ccb0c5620c1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.568255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f6146-20d9-437a-964f-6ccb0c5620c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.626138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7a8f6146-20d9-437a-964f-6ccb0c5620c1 None None] MFA Rules not processed for user `9f949a3ceab34990812bd60d2e1258f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:00.627375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7a8f6146-20d9-437a-964f-6ccb0c5620c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.709954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 757/1502] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:00.723691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.723979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.724258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.725636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 746/1503] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 24 14:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:52:00.730984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab980c9-40f2-47d6-8714-1076fb4d043a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:00.731264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab980c9-40f2-47d6-8714-1076fb4d043a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:00.731529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab980c9-40f2-47d6-8714-1076fb4d043a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:00.763391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:00.806199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1ab980c9-40f2-47d6-8714-1076fb4d043a None None] MFA Rules not processed for user `4bb596b4e1074e5d85dec4ed71dc3052`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:00.808260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1ab980c9-40f2-47d6-8714-1076fb4d043a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.886424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 758/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 24 14:52:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:00.894137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:00.895657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:00.968874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:01.024319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2348d2-93b8-455d-80ab-98ee70a70f0a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:01.106775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:01.107381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.107658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.107928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.109606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:01.214014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:01.215462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:01.219047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:01.234398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 747/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:01.280729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eb15-417d-45c6-b8f0-4a164f8cde63 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.281193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eb15-417d-45c6-b8f0-4a164f8cde63 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.281309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057eb15-417d-45c6-b8f0-4a164f8cde63 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.282523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 759/1506] 10.222.0.47 () {52 vars in 830 bytes} [Wed Aug 24 14:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:52:01.286410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:01.287626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:01.390918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0355b5-458e-4307-a091-737df42d5f62 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:01.488916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:01.489574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.489854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.490140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] PATH_INFO: `/v3/users/9f949a3ceab34990812bd60d2e1258f9` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.502936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f949a3ceab34990812bd60d2e1258f9)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:01.503969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:52:01.503969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:52:01.503969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:52:01.505234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:01.515945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:01.699063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f949a3ceab34990812bd60d2e1258f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.699835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f949a3ceab34990812bd60d2e1258f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.700465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f949a3ceab34990812bd60d2e1258f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.717304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f949a3ceab34990812bd60d2e1258f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.741111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f949a3ceab34990812bd60d2e1258f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:01.804595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 748/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:52:01 2022] DELETE /identity/v3/users/9f949a3ceab34990812bd60d2e1258f9 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:01.814332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:01.814702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:01.814975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:01.874603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:52:01.875864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:01.960183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:01.975589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 760/1508] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:52:01.985859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:01.987106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:02.103120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53fa9c-e1dd-44b1-bcf3-a89508961cb6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:02.172965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:02.197177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:02.197797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:02.198137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:02.198947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:02.201409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:02.335723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:02.337762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8efc08-10b1-4f70-b88b-bbc47fe74500 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:02.358725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 749/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:52:02.887774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:52:02.889043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:52:02.900579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd95f9-6beb-4287-b1ea-38578493eafc None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:52:03.017270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:52:03.017903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:52:03.018183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:52:03.018450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] PATH_INFO: `/v3/projects/af347d60e91b4aa3ac8bd333d97115c4` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:52:03.028441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af347d60e91b4aa3ac8bd333d97115c4)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:52:03.029507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:52:03.029507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:52:03.029507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:52:03.030737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:52:03.169972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af347d60e91b4aa3ac8bd333d97115c4', 'request_id': 'req-a120b854-f258-433c-ac1a-071133aef6c7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:03.183950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af347d60e91b4aa3ac8bd333d97115c4', 'request_id': 'req-a120b854-f258-433c-ac1a-071133aef6c7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:03.190862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af347d60e91b4aa3ac8bd333d97115c4', 'request_id': 'req-a120b854-f258-433c-ac1a-071133aef6c7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:03.274610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] The token cache is being invalidate because project af347d60e91b4aa3ac8bd333d97115c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:52:03.274896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:03.275322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a120b854-f258-433c-ac1a-071133aef6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:52:03.277121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 761/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:52:02 2022] DELETE /identity/v3/projects/af347d60e91b4aa3ac8bd333d97115c4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:52:12.356521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=62 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:52:13.272273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:42.832517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:42.833146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:42.833146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:42.834570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:53:42.840827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c635-935e-4c72-985b-6a3b2409c1ac None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:42.842572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c635-935e-4c72-985b-6a3b2409c1ac None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:42.842965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c635-935e-4c72-985b-6a3b2409c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:42.927749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f2b3c635-935e-4c72-985b-6a3b2409c1ac None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:42.928998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f2b3c635-935e-4c72-985b-6a3b2409c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:43.033486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:43.205552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:43.207645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:43.330294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c39da2-98db-4f96-abc5-d1cf83b35169 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:43.335859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:43.336471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:43.336951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:43.337225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:43.345676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:43.347671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cdebd-1946-40cc-b929-a18be15562a3 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:43.357803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 751/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:44.222364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c69-fd72-408b-8771-5bdc706981cd None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:44.222963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c69-fd72-408b-8771-5bdc706981cd None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:44.222963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c69-fd72-408b-8771-5bdc706981cd None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:44.224285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:53:44.230580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550822-fe66-4dbe-b6cd-dfdbca6748e1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:44.231223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550822-fe66-4dbe-b6cd-dfdbca6748e1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:44.231223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac550822-fe66-4dbe-b6cd-dfdbca6748e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:44.254267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ac550822-fe66-4dbe-b6cd-dfdbca6748e1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:44.255551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ac550822-fe66-4dbe-b6cd-dfdbca6748e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:44.264540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:53:44.418277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c69-fd72-408b-8771-5bdc706981cd None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:44.433146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c69-fd72-408b-8771-5bdc706981cd None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:44.438518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:44.439109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:44.439386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:44.439656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:44.447966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:44.449596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c47aca-dc72-4755-94ec-513462ba9663 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:44.458960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 764/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:45.073360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423f33-ce96-47e1-b551-945a8425903f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:45.073785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423f33-ce96-47e1-b551-945a8425903f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:45.074061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5423f33-ce96-47e1-b551-945a8425903f None None] PATH_INFO: `/v3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:45.075338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 753/1517] 10.222.0.88 () {54 vars in 925 bytes} [Wed Aug 24 14:53:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:53:45.081685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34504-d85d-448e-81a3-dbe7fe06f0d7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:45.081970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34504-d85d-448e-81a3-dbe7fe06f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:45.082243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda34504-d85d-448e-81a3-dbe7fe06f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:45.146371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-bda34504-d85d-448e-81a3-dbe7fe06f0d7 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:45.147505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bda34504-d85d-448e-81a3-dbe7fe06f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:45.165768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:53:45.225637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 765/1518] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 14:53:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:49.292679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020391c0-9253-43bd-b3a9-9307afa1084e None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:49.293306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020391c0-9253-43bd-b3a9-9307afa1084e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:49.293306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020391c0-9253-43bd-b3a9-9307afa1084e None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:49.294592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 754/1519] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 24 14:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:53:49.299727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1330c2-de8e-4c35-8d02-9c758fe87efc None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:49.300171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1330c2-de8e-4c35-8d02-9c758fe87efc None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:49.300274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1330c2-de8e-4c35-8d02-9c758fe87efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:49.319206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6b1330c2-de8e-4c35-8d02-9c758fe87efc None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:49.320485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6b1330c2-de8e-4c35-8d02-9c758fe87efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:49.329119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 766/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 24 14:53:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:49.337084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020391c0-9253-43bd-b3a9-9307afa1084e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:49.350365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020391c0-9253-43bd-b3a9-9307afa1084e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:49.355969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:49.356565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:49.356875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:49.357146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:49.365343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:49.366937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203beea1-25a2-40d5-963f-1488b7b9a568 service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:49.376811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 755/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:55.712946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7a1-06c6-4ff0-a99b-7151fc30ec83 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:55.713497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7a1-06c6-4ff0-a99b-7151fc30ec83 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:55.713497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267d7a1-06c6-4ff0-a99b-7151fc30ec83 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:55.714756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:53:55.719516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2704-f8a2-4a51-8b82-e537012ecc72 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:55.719965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2704-f8a2-4a51-8b82-e537012ecc72 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:55.720062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2704-f8a2-4a51-8b82-e537012ecc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:55.739689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0dca2704-f8a2-4a51-8b82-e537012ecc72 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:55.740925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0dca2704-f8a2-4a51-8b82-e537012ecc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:55.749317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:55.907488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d7a1-06c6-4ff0-a99b-7151fc30ec83 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:55.921607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267d7a1-06c6-4ff0-a99b-7151fc30ec83 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:55.926988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:55.927569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:55.927843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:55.928110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:55.936792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:55.938442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a39d8-8fb8-4807-a5ad-d43835314c6f service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:55.949443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 768/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:53:56.792368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d24f-2a7d-458a-9801-436a37ab266b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:56.793179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d24f-2a7d-458a-9801-436a37ab266b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:56.793179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d24f-2a7d-458a-9801-436a37ab266b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:56.794473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 14:53:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:53:56.799699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2078e-46e0-431d-ab97-3caf7866b294 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:56.800145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2078e-46e0-431d-ab97-3caf7866b294 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:56.800261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2078e-46e0-431d-ab97-3caf7866b294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:56.819776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6cc2078e-46e0-431d-ab97-3caf7866b294 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:53:56.821853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6cc2078e-46e0-431d-ab97-3caf7866b294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:53:56.829793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 14:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:53:56.980870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d24f-2a7d-458a-9801-436a37ab266b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:53:56.996160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d24f-2a7d-458a-9801-436a37ab266b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:53:57.001547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:53:57.002140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:53:57.002423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:53:57.002688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:53:57.011392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:53:57.013118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81627ff1-2eeb-49f5-905b-2f5a5ce47f59 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:53:57.022670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 758/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:53:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:01.040494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:01.041092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:01.041092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:01.042404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:54:01.047553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6d82-c6cf-47c1-9b62-24dbd705c991 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:01.047956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6d82-c6cf-47c1-9b62-24dbd705c991 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:01.048084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea6d82-c6cf-47c1-9b62-24dbd705c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:01.067661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c1ea6d82-c6cf-47c1-9b62-24dbd705c991 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:54:01.068887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c1ea6d82-c6cf-47c1-9b62-24dbd705c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:01.077232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:54:01.365022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:01.366838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:01.462609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae68cd-f18c-4505-8af1-5a7930fe8fe5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:01.466906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:01.467523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:01.467804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:01.468077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:01.478179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:01.479154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976078c-3d40-48c1-8895-40f57eaba3f3 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:01.489137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 771/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:03.496907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f461b8-4e06-46ac-80c3-697bb253f75b None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:03.497481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f461b8-4e06-46ac-80c3-697bb253f75b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:03.497481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f461b8-4e06-46ac-80c3-697bb253f75b None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:03.498840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:54:03.506055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0210bbc-10ce-47ca-8078-651bfa688f34 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:03.506565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0210bbc-10ce-47ca-8078-651bfa688f34 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:03.506991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0210bbc-10ce-47ca-8078-651bfa688f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:03.530942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a0210bbc-10ce-47ca-8078-651bfa688f34 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:54:03.532764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a0210bbc-10ce-47ca-8078-651bfa688f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:03.544287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:54:03.874944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f461b8-4e06-46ac-80c3-697bb253f75b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:03.887907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f461b8-4e06-46ac-80c3-697bb253f75b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:03.891484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:03.892080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:03.892360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:03.892632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:03.903273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:03.904877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7fee-c4e8-4fc7-a90c-c394b29f584b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:03.917116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 761/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:07.427209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:07.427752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:07.427752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:07.429149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:54:07.435067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a3fd-ecea-41e4-8f72-e6f347b60121 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:07.435478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a3fd-ecea-41e4-8f72-e6f347b60121 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:07.435613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a3fd-ecea-41e4-8f72-e6f347b60121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:07.455746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e0a6a3fd-ecea-41e4-8f72-e6f347b60121 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:54:07.456964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e0a6a3fd-ecea-41e4-8f72-e6f347b60121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:07.464813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:54:08.019597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:08.022053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:08.092261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:08.106312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f221e-a729-4cb3-baac-0799e73defc1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:08.110006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:08.110608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:08.111193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:08.111193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:08.120510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:08.121976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770b685-0cf4-4b1d-a3fc-5a6fa98f3745 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:08.131382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 774/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:10.068670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:10.069280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:10.069280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:10.070619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 14:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:54:10.076122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0017a3-fb5b-42ef-84a0-f40e3166d55b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:10.076544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0017a3-fb5b-42ef-84a0-f40e3166d55b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:10.076678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0017a3-fb5b-42ef-84a0-f40e3166d55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:10.095955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ff0017a3-fb5b-42ef-84a0-f40e3166d55b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:54:10.097464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ff0017a3-fb5b-42ef-84a0-f40e3166d55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:10.105951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 14:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:54:10.663744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:54:10.665642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:54:10.678596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1201bf77-18e4-42d3-8783-2c55faef5ac1 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:54:10.682372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:54:10.682958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:54:10.683234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:54:10.683501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:54:10.692176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:54:10.693631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927085a-7a61-420b-bf77-bb348ea68c14 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:54:10.703343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 764/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:54:20.091179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=11 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:54:20.699345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:39.499673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.502848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.502848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.529032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:39.530739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:39.548011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 776/1540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:39.558226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.558886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.558886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.593462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:39.594719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:39.607235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 765/1541] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:39.612141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:39.623920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7697d-2a2a-4dc0-bce3-0ac3b1d24b41 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:39.634422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:39.635015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.635304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.635616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.636244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:39.636553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:39.638283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22d86-bfed-486d-8e5b-31f1f16372d0 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:39.658643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 777/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:39.668521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:39.678727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f99ad-ff90-4330-8c0a-960d58e32288 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:39.688962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:39.689603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.689888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.690166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.690813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:39.692770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68cfaa0-ca7f-4663-b9ff-67df8d7fe4d8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:39.785634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.786024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.786212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.826464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:39.827587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 766/1543] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:39.831363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:39.859947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8272-55fe-4498-ac5b-3f8834bbf8f8 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.859947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8272-55fe-4498-ac5b-3f8834bbf8f8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.859947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d8272-55fe-4498-ac5b-3f8834bbf8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.894938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a37d8272-55fe-4498-ac5b-3f8834bbf8f8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:39.904809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a37d8272-55fe-4498-ac5b-3f8834bbf8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:39.949126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 778/1544] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:39.950487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:39.968226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f006f228-7595-4ab7-9c9d-7e1b083d9c0d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:39.974067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:39.974692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.974971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.975241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:39.975992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:39.980857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb6297-12ec-45a5-ba1c-4b207b7e20ed admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:39.994182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 767/1545] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:39.994182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed945-473a-4ab7-aacf-cfce34ebb17e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:39.994182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed945-473a-4ab7-aacf-cfce34ebb17e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:39.994182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed945-473a-4ab7-aacf-cfce34ebb17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.014631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-279ed945-473a-4ab7-aacf-cfce34ebb17e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.015866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-279ed945-473a-4ab7-aacf-cfce34ebb17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.024535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 768/1546] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.025864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57caa-b0fa-4930-b9a5-791173ad548a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.026151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57caa-b0fa-4930-b9a5-791173ad548a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.026425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca57caa-b0fa-4930-b9a5-791173ad548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.047433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1ca57caa-b0fa-4930-b9a5-791173ad548a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.048641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1ca57caa-b0fa-4930-b9a5-791173ad548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.057042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 769/1547] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.058253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341b6c-99e3-4ab3-aede-f7301f3ea774 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.058526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341b6c-99e3-4ab3-aede-f7301f3ea774 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.058795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e341b6c-99e3-4ab3-aede-f7301f3ea774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.078869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-2e341b6c-99e3-4ab3-aede-f7301f3ea774 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.080111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2e341b6c-99e3-4ab3-aede-f7301f3ea774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.089153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 770/1548] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.090416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d36b-8eed-46ae-845f-da82334bf035 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.090695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d36b-8eed-46ae-845f-da82334bf035 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.090968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d36b-8eed-46ae-845f-da82334bf035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.111436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7cf6d36b-8eed-46ae-845f-da82334bf035 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.112641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7cf6d36b-8eed-46ae-845f-da82334bf035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.120482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 771/1549] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.121686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccd62-e350-4bba-a2b8-cbd4768ee5d3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.121967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccd62-e350-4bba-a2b8-cbd4768ee5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.122242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ccd62-e350-4bba-a2b8-cbd4768ee5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.140057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 779/1550] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:39 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:40.140057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4a49-95ae-472a-9a00-808865030a0d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.146308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4a49-95ae-472a-9a00-808865030a0d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.146308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f4a49-95ae-472a-9a00-808865030a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.146515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c45ccd62-e350-4bba-a2b8-cbd4768ee5d3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.146515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c45ccd62-e350-4bba-a2b8-cbd4768ee5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.154457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 772/1551] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.155664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891e96-3748-4f59-ab3e-f44a6ca65933 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.155947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891e96-3748-4f59-ab3e-f44a6ca65933 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.156216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891e96-3748-4f59-ab3e-f44a6ca65933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.162136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d20f4a49-95ae-472a-9a00-808865030a0d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.163920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d20f4a49-95ae-472a-9a00-808865030a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.172394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 780/1552] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.176999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed857f0-797f-4101-945e-25e7de45a856 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.176999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed857f0-797f-4101-945e-25e7de45a856 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.176999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed857f0-797f-4101-945e-25e7de45a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.177856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-52891e96-3748-4f59-ab3e-f44a6ca65933 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.180069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-52891e96-3748-4f59-ab3e-f44a6ca65933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.188125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 773/1553] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.189498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.189784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.190055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.198834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1ed857f0-797f-4101-945e-25e7de45a856 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.200062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1ed857f0-797f-4101-945e-25e7de45a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.208544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 781/1554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.210379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.210727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.211033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.214227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.215458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.223909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 774/1555] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.224761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.234306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581848-e2b7-420d-82b5-0fdc1153221f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.235478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.236694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.238875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.239483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.239758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.240024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.240677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.241015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.242767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:55:40.242767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:55:40.242767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:55:40.243649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e528d6f-ae78-4dfd-8225-0d1864c3d5e8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.245574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 782/1556] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.246416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.256223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff7662-a29d-4f5f-9247-23d77dc2b9a0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.266828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 775/1557] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.266828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.266828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.266828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.268276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.268943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.269216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.269481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.270130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.271737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ab6b3-bebe-4615-b927-dc67597d2bc4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.285478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 783/1558] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:40.285478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.285478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.285478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.289367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.290589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.298935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 776/1559] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.303042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.308894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:40.310257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:40.310361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a40c85-0f3f-40de-99c9-228f8c7c31d3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.314955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.315567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.315850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.316123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.316811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.317117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.318563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 784/1560] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:40.318780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.319965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.330217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc56d43-0d4d-46c5-9d91-904c39ef3718 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.332402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 777/1561] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.333589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.339771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.340787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.340787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.341002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.341614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.342037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.343534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.344437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d298433-ea7c-4b6a-a3cc-44f94b3066f8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.349307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.350496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.350496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.350496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.351120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.351423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.353078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.363817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 785/1562] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.363817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.373700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 778/1563] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.373700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.373941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f419979-4919-4b67-b856-0f268c70fb3b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.373941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.373941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.374210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.374656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.375231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.375535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.377230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.386770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41223b6-77e9-4800-b9f2-d3bfa293a23a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.390692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 786/1564] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.391597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.395410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.396028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.396306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.396628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.397228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.399423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.404019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8a2e4-18b1-4ff4-8161-683466e338d5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.409360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.409960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.410236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.410499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.411127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.412754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.423020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 787/1565] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:40.423825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.433906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83960b05-78f4-4468-b6c4-b8d088f519f1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.438648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.439242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.439513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.439781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.440417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.440737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.442343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.455156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 788/1566] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.456739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.467123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469e972-230d-4c8a-9f25-eca930c7a568 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.471736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.472592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.472898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.473163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.473800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:40.474090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.475771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.487846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 789/1567] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:40.490418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.504576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6b3bb-53eb-4a4f-ab2d-94734be9b561 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.511090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.511706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.511990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.512279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.512979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.514016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:55:40.514016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:55:40.514016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:55:40.515360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.526737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 779/1568] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:40.526737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.536229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:40.595190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e6387-e2cb-4cf7-b13c-8336490a1131 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.601248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.601895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.602212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.602422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.603062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.605033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.653641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:40.660100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 790/1569] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:40.661112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.724000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29722f9b-5d62-407f-99f5-dcdfeed8f729 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:40.729833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:40.730443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:40.730722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:40.731004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:40.731618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:40.733582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:40.893833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 780/1570] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/projects => generated 375 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:40.894782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:40.928906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 791/1571] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:40.929922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.045634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e968d1-2794-439c-9b98-67aaf2de8594 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.045928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48ae91-8539-4d10-8214-7a964cefb9de admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.054906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.058491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.058626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.058726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.058824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.058920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.059017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.059113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] PATH_INFO: `/v3/projects/4de7c4b1b167433e9367d8bffe2daf53/users/772d57a2b9a44aebb5e05f7a52527ff2/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.059195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.059195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.071798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de7c4b1b167433e9367d8bffe2daf53, user_id=772d57a2b9a44aebb5e05f7a52527ff2, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.072883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:55:41.072883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:55:41.072883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:55:41.074849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.140013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 781/1572] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:40 2022] POST /identity/v3/projects => generated 391 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.140935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.177646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 792/1573] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:40 2022] PUT /identity/v3/projects/4de7c4b1b167433e9367d8bffe2daf53/users/772d57a2b9a44aebb5e05f7a52527ff2/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:41.178459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.206886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da2b98-cb8a-4291-ba5a-fd93dd85bdb3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.232802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:41.258605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9fb341-1da0-4709-b000-6f7e416948ee admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.263391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.264001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.264279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.265499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.265499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.266174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.266800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.267085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.267375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.267465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.268037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.270041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.283609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:41.408681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 793/1574] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/projects => generated 403 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.409744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.436224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 782/1575] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/projects => generated 377 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.437348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.483127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4856fb1-39ee-4609-80e7-c62814eb0e23 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.508616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1988fd-8a8b-471f-b743-7f80960ef915 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.513718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.514339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.514667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.514891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.515522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.516589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:55:41.516589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:55:41.516589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:55:41.517881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.544975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.545593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.545899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.546173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.546811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.548768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.629738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 783/1576] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.630706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.642603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed30e69-1770-4feb-b7dd-5b96718f0563 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.653699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.654385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.664507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.664507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.664507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.664507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.665193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 794/1577] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 294 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.665193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.671407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24032695-4bb7-4648-bdbe-c2ea11379b3e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.676510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.677172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.677461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.677733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.678372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.680655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ec7526-26b0-4b0e-98db-7b719946dff7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.770277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 784/1578] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.771570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.785584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d1fcb-6d18-4653-a7a5-036dcb06d3ae admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.790400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.791016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.791294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.791564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.792227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.794278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.812693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 795/1579] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.814374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.814668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.816474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.844947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] MFA Rules not processed for user `772d57a2b9a44aebb5e05f7a52527ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:41.846196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:41.923050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 796/1580] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:41.923933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.929661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:41.932126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 785/1581] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:41.933312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:41.935926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91faa0fa-fbc1-4a6e-85b9-78520a780cce None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.940461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.941124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.941407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.941675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.942337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.943858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b56a0-2030-4444-9593-636d640875c3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:41.944418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:41.949985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:41.950599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:41.950880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:41.951155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:41.951799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:41.953745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.041587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 797/1582] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 302 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:42.042358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.052113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c3fd-f2f3-4316-b5f2-b0c59ca95583 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.057231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.057835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.058108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.058375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.059007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.060612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.069457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 786/1583] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:41 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:42.071110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.075536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 798/1584] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.076412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.082019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa0aa8-b03b-43df-b495-c4b13e727df8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.087381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3809-c4d4-4f98-afc9-1c6fa00965cd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.087693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.088431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.088648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.088956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.089908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.092179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.092809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.092932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.093087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.093349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.093988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.095584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.105794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 787/1585] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.106615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.110113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 799/1586] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.110113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.119605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa83c8-ca16-4d98-b779-94d74240fab1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.121054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7fe7f-bdec-42bb-b35d-e12a918bcea7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.124364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.125005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.125416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.125690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.125909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.126323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.126568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.126906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.127184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.127987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.128231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.129737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.141735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 788/1587] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.142377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.153263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fa015-6d4e-422d-9359-fcb3b720ba76 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.158611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.159430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.163364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.163364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.163364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.163364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.173495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 789/1588] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.174335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.185400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a435d-c2d2-49cc-9d26-1d7b791c1d08 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.190080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.190690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.190963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.191225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.191860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.193560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.205019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 790/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.205914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.212153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:42.216038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb94c1b-6c67-438f-baef-e4c92bbb4661 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.220911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.221515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.221795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.222421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.223122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.224659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.225366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 800/1590] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:42 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:42.226624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.236156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 791/1591] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.237108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.247642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc57138-e9fc-4a90-a387-7f8e91c6ef0a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.294163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a02c94-fd86-4cb9-9da4-36de82d90937 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.299615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.300240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.300596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.301050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.301932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.303574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.308984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.309628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.309899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.310173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.310813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.312418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.315495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 801/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.316243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.330213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 792/1593] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.330213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.333295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faebc4b8-6c77-414b-b1c0-75e7db5c238d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.339012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.339216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e5192-f979-4e71-932a-19fe0f479b45 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.339647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.339913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.340183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.340955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.342501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.343853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.344470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.344790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.345070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.345715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.347599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.354747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 802/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.358565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.364575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 793/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.364575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.369538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994af44e-2253-4f6e-b00e-74a2fccf275c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.376742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.377047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe177a-8abf-4e96-89d6-9272e0e45be9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.377368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.377786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.378067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.378714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.380336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.387101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.387718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.388001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.388280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.388970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.390601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.393146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 803/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.394054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.404766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ade57-0683-44dd-9e32-afde49f4ea53 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.405183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 794/1597] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.406100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.411133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.411734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.412008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.412283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.412968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.415184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.419542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363965d5-b3af-4bb8-bad8-5ec91454604f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.424249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.424895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.425167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.425466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.426229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.427871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.440096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 795/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:42.441375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.457227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2ab3c-602c-4a38-94d0-9a1fabbce3d2 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.462039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.462714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.462993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.463280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] PATH_INFO: `/v3/projects/4b5f1802c82544ac9ff3f86a9bde8aba/users/9923c5f448d34c3eb1a6a92746619626/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.479991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5f1802c82544ac9ff3f86a9bde8aba, user_id=9923c5f448d34c3eb1a6a92746619626, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.482754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.553408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 804/1599] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:42 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:42.553408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.561987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5ce29-22c7-4367-b299-65a0d81b38c2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.566666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.567334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.567609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.567886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] PATH_INFO: `/v3/projects/49e76523fb464226a537bbfd6b419b3b/users/91941658f2aa4a2a84c67a49fdfca8f5/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.584050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e76523fb464226a537bbfd6b419b3b, user_id=91941658f2aa4a2a84c67a49fdfca8f5, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.584357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 796/1600] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/4b5f1802c82544ac9ff3f86a9bde8aba/users/9923c5f448d34c3eb1a6a92746619626/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:42.585366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.599743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.654079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b10961-4613-4032-b93d-5cec67cb2304 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.658865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.659558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.659837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.660111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] PATH_INFO: `/v3/projects/6acf600fa30747488c7c980a9c6bd266/users/909f59653f9a45ceafe8fb4ab683c0d6/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.676185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6acf600fa30747488c7c980a9c6bd266, user_id=909f59653f9a45ceafe8fb4ab683c0d6, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.678944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.728066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 805/1601] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/49e76523fb464226a537bbfd6b419b3b/users/91941658f2aa4a2a84c67a49fdfca8f5/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:42.728948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.764088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:42.791876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deafab6-57db-49da-a13a-ca18f4c86bc2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.797122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.797786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.798089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.798471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] PATH_INFO: `/v3/projects/8011e151fe364f3abb906f9ead35cbad/users/7aef7a912bf8468283f4f420940cc639/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.810714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 797/1602] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/6acf600fa30747488c7c980a9c6bd266/users/909f59653f9a45ceafe8fb4ab683c0d6/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:42.810714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.821537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8011e151fe364f3abb906f9ead35cbad, user_id=7aef7a912bf8468283f4f420940cc639, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.824374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.846204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:42.891983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127f00f-2c4e-427d-a4ee-3a661f12bea6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.896772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.897448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.897727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.898002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] PATH_INFO: `/v3/projects/b2cca963208149f4af347a55588149d6/users/e9e1efb821884a09a39371bc5b792a83/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.904321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 806/1603] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/8011e151fe364f3abb906f9ead35cbad/users/7aef7a912bf8468283f4f420940cc639/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:42.905170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:42.915050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2cca963208149f4af347a55588149d6, user_id=e9e1efb821884a09a39371bc5b792a83, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.923175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:42.973831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108deab3-b788-4d1a-a73d-aa78505c2203 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:42.980255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:42.981026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:42.981299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:42.981567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] PATH_INFO: `/v3/projects/4bd788a5c5a04f54821930409b860e6d/users/1f02dea8bf14424290346d3270f4fcc1/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:42.996991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd788a5c5a04f54821930409b860e6d, user_id=1f02dea8bf14424290346d3270f4fcc1, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:42.999909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.007500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 798/1604] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/b2cca963208149f4af347a55588149d6/users/e9e1efb821884a09a39371bc5b792a83/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:43.009007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.072739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b48f24-8b66-4e80-ad6b-1729fceec5a1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.077446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.078113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.078392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.078662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] PATH_INFO: `/v3/projects/f10eff49529d4b38bd6adfc3c7f9347c/users/3c08295ca49d491aab50e7b5fd300a71/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.095003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10eff49529d4b38bd6adfc3c7f9347c, user_id=3c08295ca49d491aab50e7b5fd300a71, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.098052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb6a18-9f2c-41d5-a6b9-e025cf900807 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.098876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 807/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:42 2022] PUT /identity/v3/projects/4bd788a5c5a04f54821930409b860e6d/users/1f02dea8bf14424290346d3270f4fcc1/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:43.103933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.167985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 799/1606] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:43 2022] PUT /identity/v3/projects/f10eff49529d4b38bd6adfc3c7f9347c/users/3c08295ca49d491aab50e7b5fd300a71/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:43.168843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb68554-61c4-4e20-82bc-74983b9bca9b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.172804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f206707-7f2f-44ef-ba88-28d50176af05 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.172804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f206707-7f2f-44ef-ba88-28d50176af05 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.172804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f206707-7f2f-44ef-ba88-28d50176af05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.201542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7f206707-7f2f-44ef-ba88-28d50176af05 None None] MFA Rules not processed for user `9923c5f448d34c3eb1a6a92746619626`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.203068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f206707-7f2f-44ef-ba88-28d50176af05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.219594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:43.233797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.234595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.234869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.235134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.235783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.237575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e050a-30de-4303-b104-729acedba5cb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.248738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 808/1607] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:43.250432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de293-50ab-4633-9568-0bcd15a43b84 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.250721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de293-50ab-4633-9568-0bcd15a43b84 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.250993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3de293-50ab-4633-9568-0bcd15a43b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.272878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ee3de293-50ab-4633-9568-0bcd15a43b84 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.274848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee3de293-50ab-4633-9568-0bcd15a43b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.289951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 809/1608] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.290738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 800/1609] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.290738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887486fd-1f45-427c-b020-ac1b5e69c820 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.290738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887486fd-1f45-427c-b020-ac1b5e69c820 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.290738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887486fd-1f45-427c-b020-ac1b5e69c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.291106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.291106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.291106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.309214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-887486fd-1f45-427c-b020-ac1b5e69c820 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.310442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-887486fd-1f45-427c-b020-ac1b5e69c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.321042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 801/1610] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.322330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b9a89-7f36-4460-9a2d-f8a552b9ce88 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.322616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b9a89-7f36-4460-9a2d-f8a552b9ce88 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.322945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b9a89-7f36-4460-9a2d-f8a552b9ce88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.330661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] MFA Rules not processed for user `909f59653f9a45ceafe8fb4ab683c0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.333159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.336219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:43.348679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6a9b9a89-7f36-4460-9a2d-f8a552b9ce88 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.350381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6a9b9a89-7f36-4460-9a2d-f8a552b9ce88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.357797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 802/1611] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.359193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c9a0-61c7-4c61-8034-7d0af060b24f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.359495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c9a0-61c7-4c61-8034-7d0af060b24f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.359744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881c9a0-61c7-4c61-8034-7d0af060b24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.384887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4881c9a0-61c7-4c61-8034-7d0af060b24f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.386101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4881c9a0-61c7-4c61-8034-7d0af060b24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.396192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 803/1612] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.397651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.397939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.398208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.417547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 810/1613] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.417547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.425928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.427031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.428970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292618d-81d6-42f9-b14c-4112bb2b0b69 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.435111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.435313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 804/1614] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:43.435834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.437573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.437722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.437986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] PATH_INFO: `/v3/projects/7ae4dacc52c54c35b808e77adfc7b588/users/905a113198b04007804e56bc71cc77e5/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.455622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae4dacc52c54c35b808e77adfc7b588, user_id=905a113198b04007804e56bc71cc77e5, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.458784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.503401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99f3a0-cf9d-43b2-8986-7e15aa891243 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.507706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.509189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.509655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.509933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.520243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.521729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.532876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 811/1615] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:43 2022] PUT /identity/v3/projects/7ae4dacc52c54c35b808e77adfc7b588/users/905a113198b04007804e56bc71cc77e5/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:43.536679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 805/1616] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.536679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.537161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.543258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d4806-23b2-4341-999b-b73f6167eb27 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.599069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0deae-a5ab-4a9e-b352-5fe4d714f61e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.600261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.600917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.601192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.601468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.603662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.604345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.604747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.605075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.666624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:43.670755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.672787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.678662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.681886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.684397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 812/1617] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.698595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 806/1618] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.701013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.701845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.711135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b458440-5189-4743-a8eb-1ffa41ec6b20 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.714965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5446ab7-863c-4ad7-bf0b-d460d4de06ad service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.716660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.717402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.717652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.718208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.723246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.723958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.724746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.725209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.731135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.733172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.740697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.743494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113c849-649d-4665-8ce6-26a5345c21f3 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.748074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 813/1619] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.749021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.750824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.770670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 807/1620] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.770800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d362886-5fe2-4809-aa00-92f41d825bac service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.770898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934264cc-d018-4b97-a37c-1306e8ef9e19 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.770898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934264cc-d018-4b97-a37c-1306e8ef9e19 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.770898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934264cc-d018-4b97-a37c-1306e8ef9e19 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.770898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 808/1621] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 14:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:43.770898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934264cc-d018-4b97-a37c-1306e8ef9e19 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.771299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.771299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.771299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.771299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.782477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.783309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934264cc-d018-4b97-a37c-1306e8ef9e19 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.784820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f75d95-b28d-4052-91b0-9922e45e9972 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.790263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.791070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.791431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.792174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.799344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.799344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.800978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 814/1622] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:43.802397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.802687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.803120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.808821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 809/1623] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:43.814142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:43.834109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d678a-f80d-4667-ac14-edb806c68269 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:43.834770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:43.835537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.836452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.836836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] PATH_INFO: `/v3/projects/7ae4dacc52c54c35b808e77adfc7b588/users/905a113198b04007804e56bc71cc77e5/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.839018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae4dacc52c54c35b808e77adfc7b588, user_id=905a113198b04007804e56bc71cc77e5, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:43.841785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca1611-dad3-4835-b5b7-b7225837bf14 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:43.849719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:43.855445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.862584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 810/1624] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:43 2022] PUT /identity/v3/projects/7ae4dacc52c54c35b808e77adfc7b588/users/905a113198b04007804e56bc71cc77e5/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:43.862840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:43.868429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:43.868885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:43.869370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:43.909577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] MFA Rules not processed for user `905a113198b04007804e56bc71cc77e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:43.910955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:44.018588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 815/1625] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:44.034310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:44.050365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 811/1626] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:55:44.053240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a2f9a-b6ec-46ac-890e-162985511472 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:44.068474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:44.068950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:44.069158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.069501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.069829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.157722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d00e12-fcd1-45cd-88bf-73a28e1d9acc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:44.163680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:44.165448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.165932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.166415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.173576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:44.176674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:44.180496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:44.182040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac250c-365e-4a04-9b49-83bd921e4bc0 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:44.189661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 816/1627] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:44.196330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 812/1628] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:55:44.533675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:44.552194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b3d7f-68b9-457f-9572-f6e6ac10af6b service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:44.559538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:44.560332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.560727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.563387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.693935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:44.716952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:44.719082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf298d25-e870-48f6-b719-d084773459ea service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:44.747011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 817/1629] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:44.835738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15023d5-42fe-4d18-8d61-c9247c4abbe0 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.835738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15023d5-42fe-4d18-8d61-c9247c4abbe0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.835738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15023d5-42fe-4d18-8d61-c9247c4abbe0 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.841366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 813/1630] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 24 14:55:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:44.848608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0bb-e42f-4423-b577-ade4ac6c48b6 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.849144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0bb-e42f-4423-b577-ade4ac6c48b6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.849324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79c0bb-e42f-4423-b577-ade4ac6c48b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.899387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9c79c0bb-e42f-4423-b577-ade4ac6c48b6 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:44.904872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9c79c0bb-e42f-4423-b577-ade4ac6c48b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:44.938553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 818/1631] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 24 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:44.948640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed60276-d847-49dc-88b5-7e6de9d9218e None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.949338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed60276-d847-49dc-88b5-7e6de9d9218e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.949953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed60276-d847-49dc-88b5-7e6de9d9218e None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.953113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 814/1632] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 14:55:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:44.959553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750587-924e-4ded-9265-08611f46fda5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:44.960006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750587-924e-4ded-9265-08611f46fda5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:44.960398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65750587-924e-4ded-9265-08611f46fda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:44.986479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-65750587-924e-4ded-9265-08611f46fda5 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:44.987661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-65750587-924e-4ded-9265-08611f46fda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:45.005584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 819/1633] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:55:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:45.281671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed60276-d847-49dc-88b5-7e6de9d9218e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:45.296965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed60276-d847-49dc-88b5-7e6de9d9218e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:45.300784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:45.301481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:45.301759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:45.302032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:45.315702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:45.317646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06f939-b0ef-428d-a2f9-21f2ff8e581d service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:45.334475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 815/1634] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:45.464061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86efaf-3feb-4584-9305-b9ddd645cc8b None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:45.464305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86efaf-3feb-4584-9305-b9ddd645cc8b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:45.464582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86efaf-3feb-4584-9305-b9ddd645cc8b None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:45.466181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 820/1635] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 14:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:45.471649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:45.473162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:45.473162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:45.495427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:45.499639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:45.512977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 816/1636] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:45.527039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86efaf-3feb-4584-9305-b9ddd645cc8b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:46.105234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86efaf-3feb-4584-9305-b9ddd645cc8b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:46.105234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:46.105234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:46.105234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:46.110192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:46.110192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:46.110192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce39f6-6b28-4ab5-ad27-afef0af170d3 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:46.110192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 821/1637] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:55:46.112332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:46.112332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f4d77-f54d-4f0b-aee0-99b796cda6bf None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:46.112332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:46.112332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:46.115607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:46.115607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] PATH_INFO: `/v3/users/909f59653f9a45ceafe8fb4ab683c0d6` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:46.115607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909f59653f9a45ceafe8fb4ab683c0d6)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:46.115607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:46.115607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:46.371909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909f59653f9a45ceafe8fb4ab683c0d6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:46.374625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909f59653f9a45ceafe8fb4ab683c0d6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:46.375609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909f59653f9a45ceafe8fb4ab683c0d6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:46.395915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909f59653f9a45ceafe8fb4ab683c0d6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:46.420193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909f59653f9a45ceafe8fb4ab683c0d6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:46.592039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 817/1638] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:55:45 2022] DELETE /identity/v3/users/909f59653f9a45ceafe8fb4ab683c0d6 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:46.604616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53e22-745c-4bb3-8208-23a247e029b8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:46.604939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53e22-745c-4bb3-8208-23a247e029b8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:46.605210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e53e22-745c-4bb3-8208-23a247e029b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:46.642720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-76e53e22-745c-4bb3-8208-23a247e029b8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:46.643010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-76e53e22-745c-4bb3-8208-23a247e029b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:46.747115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 822/1639] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:46.760021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:46.762218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:46.812595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-254a-47e5-b032-060107448fb1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:46.812964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-254a-47e5-b032-060107448fb1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:46.813313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562122d6-254a-47e5-b032-060107448fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:46.854632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-562122d6-254a-47e5-b032-060107448fb1 None None] MFA Rules not processed for user `1f02dea8bf14424290346d3270f4fcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:46.856266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-562122d6-254a-47e5-b032-060107448fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:46.865747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb138d26-deb3-417f-9611-5f7b1903f126 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:46.871261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:46.872388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:46.872910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:46.873471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:46.888098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:46.890426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:46.905726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 818/1640] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:46.968352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 823/1641] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:46.969994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:46.971856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:46.991367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f54dd9-690f-48ca-b026-d118fcb368e9 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:46.999214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:47.000746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:47.001254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:47.001926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:47.004170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:47.008527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:47.191503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 819/1642] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:46 2022] POST /identity/v3/projects => generated 403 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:47.197547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562122d6-254a-47e5-b032-060107448fb1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:47.236520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562122d6-254a-47e5-b032-060107448fb1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:47.364743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:47.410645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:47.411315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:47.411601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:47.411930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:47.412512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:47.414784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:47.545598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 824/1643] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:47 2022] POST /identity/v3/users => generated 308 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:55:47.549118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:47.577983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa715d0-1582-4a16-bdec-34974fa9ff5f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:47.595663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:47.595663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:47.595663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:47.596567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:47.597756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:47.599602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:47.628074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 820/1644] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:47.630402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:47.650443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14be6e5-14e8-4ead-8b86-0d7e2562624e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:47.665736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:47.666613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:47.667640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:47.668236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] PATH_INFO: `/v3/projects/440c476e36734da1a0e72b0969a97407/users/0be8197cd6f54311af0aa547855d8555/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:47.705880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c476e36734da1a0e72b0969a97407, user_id=0be8197cd6f54311af0aa547855d8555, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:47.710666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:47.870319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 825/1645] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:47 2022] PUT /identity/v3/projects/440c476e36734da1a0e72b0969a97407/users/0be8197cd6f54311af0aa547855d8555/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:47.871468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:47.888860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75d3c-e13f-4f3c-b3a5-60d64e57046f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:48.031158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:48.051397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:48.052337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:48.052855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:48.053311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:48.055142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:48.060519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:48.084811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 821/1646] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:55:48.090119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:48.105925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ce660-5480-4cb8-a514-f0ada78465d2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:48.112957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:48.114606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:48.114606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:48.114606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] PATH_INFO: `/v3/projects/440c476e36734da1a0e72b0969a97407/users/0be8197cd6f54311af0aa547855d8555/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:48.117749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440c476e36734da1a0e72b0969a97407, user_id=0be8197cd6f54311af0aa547855d8555, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:48.125622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7e114-9680-4b27-83f3-81d7387da0c6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:48.174935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 826/1647] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:48 2022] PUT /identity/v3/projects/440c476e36734da1a0e72b0969a97407/users/0be8197cd6f54311af0aa547855d8555/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:48.939285 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:48.943072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:48.988182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a6153-b458-4e5a-9209-cec1f3abc846 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:49.175283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:49.176321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:49.176844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] PATH_INFO: `/v3/projects/6acf600fa30747488c7c980a9c6bd266` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6acf600fa30747488c7c980a9c6bd266)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: WARNING py.warnings [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: warnings.warn(msg) Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: Aug 24 14:55:49.188828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:49.343264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6acf600fa30747488c7c980a9c6bd266', 'request_id': 'req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:49.494569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6acf600fa30747488c7c980a9c6bd266', 'request_id': 'req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:49.505293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6acf600fa30747488c7c980a9c6bd266', 'request_id': 'req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:49.544983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] The token cache is being invalidate because project 6acf600fa30747488c7c980a9c6bd266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:55:49.557124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:49.558730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2dc95de7-5c8a-4d7d-b0a7-cfec73c092f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:49.562279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 822/1648] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:55:48 2022] DELETE /identity/v3/projects/6acf600fa30747488c7c980a9c6bd266 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:49.567535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:49.567535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:49.568339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:49.609759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:49.610658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:49.715738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 827/1649] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:49.725968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:49.727135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:49.727503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:49.785030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:49.817024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:49.848847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 823/1650] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:49.854536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:49.876194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6b4e5-e716-47bb-8f3b-123bade75ddc None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:49.888234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:49.888993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:49.889274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:49.889548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:49.890237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:55:49.890546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:49.894133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:49.939087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 828/1651] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:55:49.946210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:49.989704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cc3e1-dd83-4a56-8cd1-0ecea2e16b8d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:50.019058 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:50.020418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:50.020745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:50.021013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:50.025554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:50.028236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:50.181887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:50.189827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 824/1652] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:50.197996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de08e0-b4ae-4031-befd-c7d1c29032a4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:50.439520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:50.440304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:50.440547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:50.440875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:50.458259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:50.458259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:50.751201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 829/1653] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:50 2022] POST /identity/v3/users => generated 293 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:55:50.752395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:50.774234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2acf60-3ea2-427d-a598-9b597060a8ab admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:50.809352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:50.810149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:50.810960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:50.811477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:50.812431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:50.816297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:50.845043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 825/1654] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:50.847764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:50.870284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2909df-5c32-4268-9ca7-668cb8cc4986 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:50.910138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:50.911241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:50.912385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:50.913281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:50.916541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:50.920344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607dba98-342e-4763-955f-21f8ba5d58e7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:50.935872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 830/1655] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:50.939958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:50.956855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ab517-31a4-4be7-a2e3-9c069daf1507 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:50.963495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:50.964436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:50.964952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:50.965735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] PATH_INFO: `/v3/projects/ffebc511f0824780be10f7357588d3b6/users/60b7e07c359a4a4c833e8c2e7ef0fe00/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:51.010992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffebc511f0824780be10f7357588d3b6, user_id=60b7e07c359a4a4c833e8c2e7ef0fe00, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:51.036900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:51.136403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:51.136403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:51.136403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:51.145186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 826/1656] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:50 2022] PUT /identity/v3/projects/ffebc511f0824780be10f7357588d3b6/users/60b7e07c359a4a4c833e8c2e7ef0fe00/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:55:51.161036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:51.182290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] MFA Rules not processed for user `60b7e07c359a4a4c833e8c2e7ef0fe00`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:51.184646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:51.305380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 831/1657] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:51.312579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:51.346834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:51.444434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f0340-d6c2-4725-bbaa-e0f4f8f6dfe3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:51.462434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:51.467141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:51.467141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:51.467141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:51.467141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:51.473164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:51.637254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 827/1658] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:55:51 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:51.644608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:51.660100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085f212-0fd0-4412-bc82-c65ec6862459 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:51.855267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:51.855979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:51.856215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:51.856515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:51.857285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:51.859506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:52.064118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 832/1659] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:55:51 2022] POST /identity/v3/users => generated 300 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:55:52.069168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:52.090110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aade9-5e24-4f58-8ca7-eda04daf55cd admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:52.141534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:52.142462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:52.142906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:52.143345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:52.144187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:52.146715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:52.194077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 828/1660] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:52.195955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:52.206983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70605119-c678-4a7b-b379-cd9981709aaa admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:52.222586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:52.229831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:52.230274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:52.230759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] PATH_INFO: `/v3/projects/47abdbcb405641a38fdb4c1e67f3de21/users/548f09857d7c4547bdc6b2d0315416a9/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:52.277614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47abdbcb405641a38fdb4c1e67f3de21, user_id=548f09857d7c4547bdc6b2d0315416a9, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:52.280683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:52.391263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 833/1661] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:52 2022] PUT /identity/v3/projects/47abdbcb405641a38fdb4c1e67f3de21/users/548f09857d7c4547bdc6b2d0315416a9/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:52.395660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:52.417923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee896b-db38-4167-9afd-feb39178719e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:52.572820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:52.573166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:52.573446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:52.573716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:52.574541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:52.576362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb4f41-61c4-4187-83f5-758e7d228351 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:52.605027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 829/1662] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:55:52.606217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:52.629107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dbb41-a73a-49b3-b74d-663652185d9c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:52.643001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:52.643375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:52.643672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:52.644568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] PATH_INFO: `/v3/projects/47abdbcb405641a38fdb4c1e67f3de21/users/548f09857d7c4547bdc6b2d0315416a9/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:52.651023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47abdbcb405641a38fdb4c1e67f3de21, user_id=548f09857d7c4547bdc6b2d0315416a9, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:52.658114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:52.695149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 834/1663] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:55:52 2022] PUT /identity/v3/projects/47abdbcb405641a38fdb4c1e67f3de21/users/548f09857d7c4547bdc6b2d0315416a9/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:52.701132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:52.701724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:52.702158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:52.788101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] MFA Rules not processed for user `548f09857d7c4547bdc6b2d0315416a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:52.793631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:53.041611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 830/1664] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:53.056400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:53.058598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:53.249017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:53.254992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397bfaf1-bdff-490a-a923-d51e2e6ae29b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:53.263668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:53.264694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:53.265181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:53.265760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:53.286857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:53.289908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2843b748-3b38-4acd-bb41-332647678458 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:53.314774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 835/1665] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:53.388877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:53.470800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21692d7-0317-4cd8-a1d5-3a0a34798efd None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:53.471462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21692d7-0317-4cd8-a1d5-3a0a34798efd None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:53.471941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21692d7-0317-4cd8-a1d5-3a0a34798efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:53.560922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c21692d7-0317-4cd8-a1d5-3a0a34798efd None None] MFA Rules not processed for user `0be8197cd6f54311af0aa547855d8555`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:53.563927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c21692d7-0317-4cd8-a1d5-3a0a34798efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:53.600886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93d1ba-23bf-405d-ac22-9d4258ed4470 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:53.607417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:53.608403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:53.608937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:53.609416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] PATH_INFO: `/v3/users/60b7e07c359a4a4c833e8c2e7ef0fe00` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:53.611020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b7e07c359a4a4c833e8c2e7ef0fe00)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:53.613234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:53.792955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 836/1666] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:53 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:53.910160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b7e07c359a4a4c833e8c2e7ef0fe00'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:53.916647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b7e07c359a4a4c833e8c2e7ef0fe00'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:53.917499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b7e07c359a4a4c833e8c2e7ef0fe00'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:53.927964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:53.947393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b7e07c359a4a4c833e8c2e7ef0fe00'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:54.002850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b7e07c359a4a4c833e8c2e7ef0fe00'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:54.152347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 831/1667] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:55:53 2022] DELETE /identity/v3/users/60b7e07c359a4a4c833e8c2e7ef0fe00 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:54.165525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:54.165525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:54.165525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:54.225505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:54.229606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:54.451303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 837/1668] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:54.532925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:54.535597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:54.709994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d6c9-4ad7-47fb-8573-c848afb146c8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:54.733792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:54.735099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:54.739123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:54.742895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:54.797675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:54.804403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:54.827643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 832/1669] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:56.700849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:56.702293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:56.720977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9c54-35da-410e-9a19-89e2f48d7c0b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:56.735942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:56.737246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:56.737853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:56.738364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] PATH_INFO: `/v3/projects/ffebc511f0824780be10f7357588d3b6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:56.739853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffebc511f0824780be10f7357588d3b6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:56.742386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:56.918319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffebc511f0824780be10f7357588d3b6', 'request_id': 'req-8242d389-ab86-43df-b92a-f3fbd89d9b3f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:56.927883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffebc511f0824780be10f7357588d3b6', 'request_id': 'req-8242d389-ab86-43df-b92a-f3fbd89d9b3f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:56.940101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffebc511f0824780be10f7357588d3b6', 'request_id': 'req-8242d389-ab86-43df-b92a-f3fbd89d9b3f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.083243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:57.087921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] The token cache is being invalidate because project ffebc511f0824780be10f7357588d3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:55:57.088428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.089387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8242d389-ab86-43df-b92a-f3fbd89d9b3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.092939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 838/1670] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:55:56 2022] DELETE /identity/v3/projects/ffebc511f0824780be10f7357588d3b6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:57.096857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:57.112422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3853ae-30ae-4b95-86a6-5afdc123a57b service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:57.275111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:57.334263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:57.334930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:57.335210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:57.335558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] PATH_INFO: `/v3/users/548f09857d7c4547bdc6b2d0315416a9` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:57.341060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548f09857d7c4547bdc6b2d0315416a9)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:57.346770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:57.644860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548f09857d7c4547bdc6b2d0315416a9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.645829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548f09857d7c4547bdc6b2d0315416a9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.647311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548f09857d7c4547bdc6b2d0315416a9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.658326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548f09857d7c4547bdc6b2d0315416a9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.674687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:57.684125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:57.684125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:57.686468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-434a0d18-e1ea-4fb7-8354-2620720b6641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548f09857d7c4547bdc6b2d0315416a9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:55:57.729764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] MFA Rules not processed for user `7aef7a912bf8468283f4f420940cc639`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:57.732242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:57.804255 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 833/1671] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:55:57 2022] DELETE /identity/v3/users/548f09857d7c4547bdc6b2d0315416a9 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:55:57.844437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb5e0-5e60-4938-8f79-bd8cc3673dc7 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:57.846466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb5e0-5e60-4938-8f79-bd8cc3673dc7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:57.849264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb5e0-5e60-4938-8f79-bd8cc3673dc7 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:57.856395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 834/1672] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:55:57 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:57.926572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d660a-30c4-454c-a475-f1dfe6e8d78a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:57.926877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d660a-30c4-454c-a475-f1dfe6e8d78a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:57.927127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d660a-30c4-454c-a475-f1dfe6e8d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:57.930975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 839/1673] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:57.951062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:57.953592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:58.002339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3e4d660a-30c4-454c-a475-f1dfe6e8d78a None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:58.010549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3e4d660a-30c4-454c-a475-f1dfe6e8d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:58.207364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 835/1674] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:55:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:58.290969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd482b-b329-4f75-b5d7-923b23532a3f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:58.291759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd482b-b329-4f75-b5d7-923b23532a3f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:58.292994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd482b-b329-4f75-b5d7-923b23532a3f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:58.353514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 836/1675] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 24 14:55:58 2022] GET /identity => generated 270 bytes in 66 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:55:58.355777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:58.359602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:58.372101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:58.405539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c6a8e-6c35-465e-bebd-bd975473d73a None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:58.473991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:55:58.475242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:58.513766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 837/1676] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 24 14:55:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:55:58.524747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:58.542448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11ea1f-4a50-406e-8ad7-65fd8d8a4426 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:55:58.563222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:58.563859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:58.564123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:58.564395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:58.624193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:58.625975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:58.649000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 838/1677] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:58.661931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:55:58.662850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:55:58.664220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:55:58.666922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:55:58.786568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:55:58.788609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:55:58.802258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 840/1678] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:55:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 852 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:55:59.379803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:55:59.861690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:55:59.864953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:55:59.993460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:00.059654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2cccd-9768-4cb8-b73f-62bf3e5ac10f service placement] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:00.066687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:00.075879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:00.075879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:00.075879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] PATH_INFO: `/v3/projects/47abdbcb405641a38fdb4c1e67f3de21` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:00.075879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47abdbcb405641a38fdb4c1e67f3de21)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:00.075879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:00.093378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:00.094859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:00.125051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16afdd8-634c-4cb6-b40e-4a6945d86122 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:00.149251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:00.150024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:00.150417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:00.150888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] PATH_INFO: `/v3/users/9923c5f448d34c3eb1a6a92746619626` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:00.161052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9923c5f448d34c3eb1a6a92746619626)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:00.165487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: WARNING py.warnings [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 14:56:00.165487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: warnings.warn(msg) Aug 24 14:56:00.165487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: Aug 24 14:56:00.166745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:00.357267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47abdbcb405641a38fdb4c1e67f3de21', 'request_id': 'req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.435087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47abdbcb405641a38fdb4c1e67f3de21', 'request_id': 'req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.443275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47abdbcb405641a38fdb4c1e67f3de21', 'request_id': 'req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.469371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] The token cache is being invalidate because project 47abdbcb405641a38fdb4c1e67f3de21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:00.469930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.470771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9b6a6e7-ee19-40bf-af27-08d149fb7c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.473940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 839/1679] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:55:59 2022] DELETE /identity/v3/projects/47abdbcb405641a38fdb4c1e67f3de21 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:00.487705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80cdba-81eb-47df-a835-064135d27195 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:00.488203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80cdba-81eb-47df-a835-064135d27195 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:00.488820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80cdba-81eb-47df-a835-064135d27195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:00.506688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9923c5f448d34c3eb1a6a92746619626'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.508606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9923c5f448d34c3eb1a6a92746619626'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.509482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9923c5f448d34c3eb1a6a92746619626'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.576202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6a80cdba-81eb-47df-a835-064135d27195 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:00.582809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6a80cdba-81eb-47df-a835-064135d27195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:00.645043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9923c5f448d34c3eb1a6a92746619626'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.708701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9923c5f448d34c3eb1a6a92746619626'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:00.793394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 841/1680] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:00 2022] DELETE /identity/v3/users/9923c5f448d34c3eb1a6a92746619626 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:00.793394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:00.799328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 840/1681] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:00.802876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:00.809317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311457e-a781-4a2a-81ab-48bc087a4291 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:00.809643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311457e-a781-4a2a-81ab-48bc087a4291 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:00.809867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311457e-a781-4a2a-81ab-48bc087a4291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:00.882403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7311457e-a781-4a2a-81ab-48bc087a4291 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:00.887480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7311457e-a781-4a2a-81ab-48bc087a4291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 841/1682] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:01.050067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:01.052238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2820ab9-11a7-43d7-a220-23aafb8b4405 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:01.053082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 842/1683] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:01.053183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:01.053183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.053183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.053183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] PATH_INFO: `/v3/users/1f02dea8bf14424290346d3270f4fcc1` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.053585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f02dea8bf14424290346d3270f4fcc1)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:01.053585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:01.053742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:01.062846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a1ff6-e9b5-4db3-ab23-383d4dfec492 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:01.078840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:01.079678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.080289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.080789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.081615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:01.082212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:01.083952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:01.123362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 843/1684] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:01.123362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:01.127938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:01.340830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3de51f-b85c-4e74-8a15-e428b85b97e4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:01.348516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:01.349365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.349767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.350110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.374419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:01.376138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:01.394826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:01.407773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 844/1685] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:01.409594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:01.416728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f02dea8bf14424290346d3270f4fcc1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:01.417452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f02dea8bf14424290346d3270f4fcc1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:01.419598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f02dea8bf14424290346d3270f4fcc1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:01.444103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8c1e-d018-40d3-809a-4b6a8afd383e service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:01.457392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:01.458405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:01.458805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:01.461613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:01.464440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:01.470049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:01.551973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f02dea8bf14424290346d3270f4fcc1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:01.592299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f02dea8bf14424290346d3270f4fcc1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:01.659224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 845/1686] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:01 2022] POST /identity/v3/projects => generated 381 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:01.663713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:01.668236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:01.730709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 842/1687] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:00 2022] DELETE /identity/v3/users/1f02dea8bf14424290346d3270f4fcc1 => generated 0 bytes in 936 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:01.878321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8d81b-8688-4099-9e1f-866c9f55fcd5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:02.022110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:02.023049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:02.023956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:02.024233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:02.025032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:02.027315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:02.182024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 846/1688] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:01 2022] POST /identity/v3/users => generated 291 bytes in 520 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:02.184915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:02.203958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a8e15-819b-4348-a517-4e674e777048 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:02.229585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:02.232274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:02.232274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:02.234923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:02.236998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:02.239554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:02.290485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 843/1689] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:02.291274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:02.308646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e0c72-3965-4004-855e-6eb84eef5247 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:02.331012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:02.331653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:02.333555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:02.333555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:02.333555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:02.334540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92eab11-1216-4765-ab88-2c4317e12ab7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:02.384644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:02.391268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 847/1690] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:02.398590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702288-e504-41c4-badb-957f2600d468 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:02.417862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:02.423572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:02.423572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:02.423572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] PATH_INFO: `/v3/projects/b3cf1834e8764257addcde1a5df0c9c3/users/75f8666bdc664053adfe87e54eab3f49/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:02.501028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cf1834e8764257addcde1a5df0c9c3, user_id=75f8666bdc664053adfe87e54eab3f49, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:02.509533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:02.632383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 844/1691] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:02 2022] PUT /identity/v3/projects/b3cf1834e8764257addcde1a5df0c9c3/users/75f8666bdc664053adfe87e54eab3f49/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:02.635484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:02.635918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:02.636333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:02.646544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:02.768766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] MFA Rules not processed for user `75f8666bdc664053adfe87e54eab3f49`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:02.783180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:02.946833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 848/1692] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:02.950307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:02.979681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:02.982195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.142439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ca51-d8a6-4760-bb27-09a9bc6a3deb admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:03.167882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:03.170601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.181148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.181148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.181576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44034e-236d-447a-acf4-280d78804b2f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:03.182091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:03.182091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abadbc75-18f6-4a18-92a8-160178a5e276 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:03.186500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:03.186942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.187710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.187710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] PATH_INFO: `/v3/projects/4b5f1802c82544ac9ff3f86a9bde8aba` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.189183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5f1802c82544ac9ff3f86a9bde8aba)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:03.191486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:03.335121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 845/1693] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:02 2022] POST /identity/v3/projects => generated 381 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:03.336746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5e64-12d2-4b04-b50b-48772517c0f7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.344231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5e64-12d2-4b04-b50b-48772517c0f7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.346903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b5e64-12d2-4b04-b50b-48772517c0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.393911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5f1802c82544ac9ff3f86a9bde8aba', 'request_id': 'req-0d50b14c-6aed-4115-9d49-a08b871cb0ac'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:03.423490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8a2b5e64-12d2-4b04-b50b-48772517c0f7 None None] MFA Rules not processed for user `91941658f2aa4a2a84c67a49fdfca8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:03.426600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8a2b5e64-12d2-4b04-b50b-48772517c0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.475691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5f1802c82544ac9ff3f86a9bde8aba', 'request_id': 'req-0d50b14c-6aed-4115-9d49-a08b871cb0ac'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:03.487698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5f1802c82544ac9ff3f86a9bde8aba', 'request_id': 'req-0d50b14c-6aed-4115-9d49-a08b871cb0ac'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:03.508544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] The token cache is being invalidate because project 4b5f1802c82544ac9ff3f86a9bde8aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:03.509081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:03.510038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:03.515777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 849/1694] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:02 2022] DELETE /identity/v3/projects/4b5f1802c82544ac9ff3f86a9bde8aba => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:03.515777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:03.521107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.681767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 846/1695] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:03.684948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.685245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.685522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.692530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:03.731551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50b14c-6aed-4115-9d49-a08b871cb0ac admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:03.743579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:03.743579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.748258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:03.749448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.749942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.750412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.752982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:03.755925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:03.760668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 847/1696] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:03.761743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:03.763283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.891582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 850/1697] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:03 2022] POST /identity/v3/users => generated 297 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:03.894065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:03.897562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:03.934537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4724bd-9170-4539-ae35-aad33453bdce admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:03.949606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e1adc-99f3-4e8e-acb7-f695e79cfac8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:03.962347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:03.963294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.963583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.973533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.973733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:03.973733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:03.973733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:03.973733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] PATH_INFO: `/v3/projects/4bd788a5c5a04f54821930409b860e6d` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:03.979066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd788a5c5a04f54821930409b860e6d)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:03.981007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:03.982419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:03.985955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce40cf-0476-4cce-bfe5-eedeb99935fe service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.004972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 848/1698] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:04.006802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.007759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.008372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.041620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:04.045169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:04.069158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 849/1699] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:04.073761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.093933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d7877-d9b8-42b0-9dda-3d9aca21e833 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.113855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.113855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.113855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.113855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.115541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.117923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.163123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 850/1700] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:04.167781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.182151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3297-76b0-49f3-9156-a0de4caa78a4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.188628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.190319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.191540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.191958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.194680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:04.199887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.199887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.230307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 851/1701] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:04.231558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.251449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c2f32-ee1f-41fe-a334-e38e326868df admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.258288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd788a5c5a04f54821930409b860e6d', 'request_id': 'req-6c20331a-61f3-48eb-b724-2018122a0556'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:04.371881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.373495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.373948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.374516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] PATH_INFO: `/v3/projects/80723cd4c57144289b165b972ecc2d2d/users/4693dc93918d433cad9dd1cc34faf4cc/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.424204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80723cd4c57144289b165b972ecc2d2d, user_id=4693dc93918d433cad9dd1cc34faf4cc, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.424204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.475656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd788a5c5a04f54821930409b860e6d', 'request_id': 'req-6c20331a-61f3-48eb-b724-2018122a0556'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:04.484990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd788a5c5a04f54821930409b860e6d', 'request_id': 'req-6c20331a-61f3-48eb-b724-2018122a0556'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:04.511729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] The token cache is being invalidate because project 4bd788a5c5a04f54821930409b860e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:04.512202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:04.513143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6c20331a-61f3-48eb-b724-2018122a0556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:04.524873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 852/1702] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:04 2022] PUT /identity/v3/projects/80723cd4c57144289b165b972ecc2d2d/users/4693dc93918d433cad9dd1cc34faf4cc/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:04.526161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.528159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 851/1703] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:03 2022] DELETE /identity/v3/projects/4bd788a5c5a04f54821930409b860e6d => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:04.530610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.531050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.532924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:04.534992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.605472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] MFA Rules not processed for user `3c08295ca49d491aab50e7b5fd300a71`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:04.607125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:04.697501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af7e99-d95d-4a20-ae37-7909f376cfa0 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.711855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.711855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.712751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.713442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.714129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.723301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7c50e-6ea4-4716-a940-260f11ef6375 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.756643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 852/1704] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:04.756643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.756643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:04.778975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc594ed7-4792-4336-8d17-b299f7c59c43 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.784326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.791192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.791192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.791192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.791192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.791192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.804761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 853/1705] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:04.808437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:04.808437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:04.825792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f903400-514d-44f0-a488-13aa6bd54163 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:04.832930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:04.833683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.834024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.834412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] PATH_INFO: `/v3/users/0be8197cd6f54311af0aa547855d8555` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.836702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be8197cd6f54311af0aa547855d8555)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:04.839562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:04.881436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 853/1706] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:04 2022] POST /identity/v3/projects => generated 403 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:04.881436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eedf9-28b6-4be2-8b5d-f0f0409f034f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:04.881436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eedf9-28b6-4be2-8b5d-f0f0409f034f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:04.881436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462eedf9-28b6-4be2-8b5d-f0f0409f034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:04.994076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-462eedf9-28b6-4be2-8b5d-f0f0409f034f None None] MFA Rules not processed for user `e9e1efb821884a09a39371bc5b792a83`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:04.995832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-462eedf9-28b6-4be2-8b5d-f0f0409f034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.115721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 854/1707] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:05.123538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8716-5853-4b56-8135-8f8324cd66a1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.124015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8716-5853-4b56-8135-8f8324cd66a1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.125094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8716-5853-4b56-8135-8f8324cd66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.146864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be8197cd6f54311af0aa547855d8555'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.148392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be8197cd6f54311af0aa547855d8555'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.149462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be8197cd6f54311af0aa547855d8555'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.159566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f59f8716-5853-4b56-8135-8f8324cd66a1 None None] MFA Rules not processed for user `3c08295ca49d491aab50e7b5fd300a71`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:05.160035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be8197cd6f54311af0aa547855d8555'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.161369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f59f8716-5853-4b56-8135-8f8324cd66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.180628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be8197cd6f54311af0aa547855d8555'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:05.242976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 855/1708] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:05.244901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.245439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.246609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.273591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] MFA Rules not processed for user `7aef7a912bf8468283f4f420940cc639`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:05.276329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.281204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:05.294519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 854/1709] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:04 2022] DELETE /identity/v3/users/0be8197cd6f54311af0aa547855d8555 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:05.295836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:05.297801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.448665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 856/1710] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:05.450134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:05.453585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c75127-b330-4eeb-bbfb-f0b56122117d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:05.459836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:05.461270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.461690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.462081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] PATH_INFO: `/v3/projects/80723cd4c57144289b165b972ecc2d2d/users/4693dc93918d433cad9dd1cc34faf4cc/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.464975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=80723cd4c57144289b165b972ecc2d2d, user_id=4693dc93918d433cad9dd1cc34faf4cc, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:05.468647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.472740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66bee1-17ad-4bc9-9b9d-592e1c0c61ad admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:05.487749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 855/1711] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:05 2022] PUT /identity/v3/projects/80723cd4c57144289b165b972ecc2d2d/users/4693dc93918d433cad9dd1cc34faf4cc/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:05.489797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.490123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.490456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.527129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] MFA Rules not processed for user `e9e1efb821884a09a39371bc5b792a83`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:05.531510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.673679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f1fb9-e045-4047-807e-68d108a6d3b3 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:05.697018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 856/1712] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:05.697018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:05.699246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:05.806161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:05.806788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.807056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.807394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:05.808036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:05.817312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55e931-0adb-45a9-83ca-f4f2a41054c5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:05.975467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 857/1713] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:05 2022] POST /identity/v3/users => generated 302 bytes in 526 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:05.985366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:05.985930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:05.987350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.003352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08568fd2-faef-4c3e-908b-7dcc0370f09f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.034290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.035306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.035905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.037472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.043426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.088206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] MFA Rules not processed for user `4693dc93918d433cad9dd1cc34faf4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:06.090932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.174074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.176535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.209250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 857/1714] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:06.213865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.218516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.244639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51add04-81e8-43a2-a903-712648eb2de9 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.251270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.252475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.253016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.253517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] PATH_INFO: `/v3/projects/440c476e36734da1a0e72b0969a97407` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.255792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440c476e36734da1a0e72b0969a97407)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.258766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.293954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:06.298149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 858/1715] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:06.301223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.318719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cdd149-ffbd-4461-a19f-a8d3b1b484e4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.326244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.348572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 859/1716] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:06.352368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.354613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.510504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440c476e36734da1a0e72b0969a97407', 'request_id': 'req-d1cfe875-4bfe-47be-b96f-e5a180643cc9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.547461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac8b37-adca-4523-897d-c2c47be8bc3d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.647313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440c476e36734da1a0e72b0969a97407', 'request_id': 'req-d1cfe875-4bfe-47be-b96f-e5a180643cc9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.662341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.664308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.665088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.665506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.665625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440c476e36734da1a0e72b0969a97407', 'request_id': 'req-d1cfe875-4bfe-47be-b96f-e5a180643cc9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.692229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] The token cache is being invalidate because project 440c476e36734da1a0e72b0969a97407 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:06.694861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.695286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:06.704118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 858/1717] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:06 2022] DELETE /identity/v3/projects/440c476e36734da1a0e72b0969a97407 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:06.704118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.704657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.773460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.774951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8e25-0e51-42d7-ac7d-0956366dc184 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.794938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 860/1718] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:06.798550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe98f-86a4-4a7f-aa17-b18d288e97db None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.798847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe98f-86a4-4a7f-aa17-b18d288e97db None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.799115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fe98f-86a4-4a7f-aa17-b18d288e97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.833060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cfe875-4bfe-47be-b96f-e5a180643cc9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:06.845307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-143fe98f-86a4-4a7f-aa17-b18d288e97db None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:06.846321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-143fe98f-86a4-4a7f-aa17-b18d288e97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:06.848890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:06.849516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.850125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.850125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.852439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:06.853935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88176beb-64d8-4508-8ded-df5274848c10 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:06.893836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 861/1719] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:06.903664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d1ac7-b1ac-4c03-818c-db5423aabd8d None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.904033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d1ac7-b1ac-4c03-818c-db5423aabd8d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.904314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d1ac7-b1ac-4c03-818c-db5423aabd8d None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.905652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 859/1720] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:06.908511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f65ed-34de-4668-8487-778a7f4859e5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:06.908511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f65ed-34de-4668-8487-778a7f4859e5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:06.917106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 862/1721] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 14:56:06 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:56:06.918301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d1ac7-b1ac-4c03-818c-db5423aabd8d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:06.919656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f65ed-34de-4668-8487-778a7f4859e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:06.988358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a34f65ed-34de-4668-8487-778a7f4859e5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:06.990116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a34f65ed-34de-4668-8487-778a7f4859e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.002890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d1ac7-b1ac-4c03-818c-db5423aabd8d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.008752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 860/1722] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:07.010376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ea9f-502b-41a5-8499-536036098454 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.010809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ea9f-502b-41a5-8499-536036098454 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.011091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306ea9f-502b-41a5-8499-536036098454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.018041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.019493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.019899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.020200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] PATH_INFO: `/v3/projects/21be702c65444aeba06ae80cc2a18715/users/305378661c234ce99065ac7cf78717c1/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.084491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0306ea9f-502b-41a5-8499-536036098454 None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:07.085715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21be702c65444aeba06ae80cc2a18715, user_id=305378661c234ce99065ac7cf78717c1, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.087523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0306ea9f-502b-41a5-8499-536036098454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.100252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.173226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 861/1723] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:07.174170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ea9f-502b-41a5-8499-536036098454 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.188635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306ea9f-502b-41a5-8499-536036098454 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.213753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.217328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.217660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.219587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.219587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:07.219587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.221050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.254338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 862/1724] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:07.255565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.257813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.271964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3da9c-42d4-4bfc-b3d4-3c0dadb14298 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.275890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.276724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.277082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.277362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.292887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 863/1725] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:06 2022] PUT /identity/v3/projects/21be702c65444aeba06ae80cc2a18715/users/305378661c234ce99065ac7cf78717c1/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:07.294262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.305445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.309110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22aaa3-05c3-4c78-b6f9-6d02e9be6c5e service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.330008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 863/1726] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:07.331762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6b8f-6619-47e2-902d-ee6ca5f9b2c6 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.338186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6b8f-6619-47e2-902d-ee6ca5f9b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.338444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b6b8f-6619-47e2-902d-ee6ca5f9b2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.415890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d33b6b8f-6619-47e2-902d-ee6ca5f9b2c6 None None] MFA Rules not processed for user `305378661c234ce99065ac7cf78717c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:07.421680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d33b6b8f-6619-47e2-902d-ee6ca5f9b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.464965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68067b5e-4699-4392-b469-2a488df93241 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.481403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.482305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.482855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.483493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.486200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.495688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4513ab-2353-48f4-84c4-26adb7f5dbb7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.569255 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 864/1727] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:07.571458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cfa9-d45b-4c63-ae17-1d41e05167b8 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.571958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cfa9-d45b-4c63-ae17-1d41e05167b8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.572880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4cfa9-d45b-4c63-ae17-1d41e05167b8 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.574846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 865/1728] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 24 14:56:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:56:07.575958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4cfa9-d45b-4c63-ae17-1d41e05167b8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.603462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4cfa9-d45b-4c63-ae17-1d41e05167b8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.609940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.615854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.616819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.617380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.618312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.621439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.646580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:07.687934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 864/1729] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/projects => generated 355 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:07.690594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.690594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.690594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.739490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:07.742344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:07.753860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 866/1730] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:07.753860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.844993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 865/1731] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:07.845904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:07.892789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3b129-5d8e-4879-ad7a-e3020cf1bcf9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.899470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.900361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.900760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.901138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.902474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.905054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:07.948592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6ccb2-014d-4b1c-8069-ec9440effc43 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:07.961858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:07.964470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:07.971279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:07.971720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:07.972814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:07.979148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.020646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 867/1732] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/users => generated 278 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:08.021885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.138443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 866/1733] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:07 2022] POST /identity/v3/users => generated 308 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:08.139649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.164469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60df136-e76e-40e2-9a0d-f71611eb2e36 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.201623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.223206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.223206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.223206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.223206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.223206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.263795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 867/1734] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:08.263795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.274350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f803510-adb8-4a63-a258-a3bc6a028886 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.280683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.281538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.281891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.282078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.282630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5a6bc-75bf-4e3a-a2e1-c1f69a67ef19 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.292455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.297803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.298186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.299099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.299688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.301508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.303533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.308878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.314934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 868/1735] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:08.320176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.331012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bb074-0dac-4bc0-b2b1-2eea446fbbb4 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.338536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.339250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.339536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.339962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.340700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.342446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.348310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 868/1736] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:08.351410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.363643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485f365-c444-4d77-9476-3c802cec5b50 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.372628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 869/1737] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:08.375481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.380282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.384473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.384473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.384473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] PATH_INFO: `/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7/users/d352b03d267643899194f11539ef8f37/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.389319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b4b74-02d7-40ab-ae1b-65ff2e36451c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.396656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.397591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.397879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.398157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] PATH_INFO: `/v3/projects/1549df946efb4878ad0fc77ebb12adf4/users/e425449746c74f84980c53b32abfe62d/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.412763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63233c9dfed64bc99dce773c2a8d3ed7, user_id=d352b03d267643899194f11539ef8f37, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.416151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.432150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1549df946efb4878ad0fc77ebb12adf4, user_id=e425449746c74f84980c53b32abfe62d, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.436061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.625465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 869/1738] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:08 2022] PUT /identity/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7/users/d352b03d267643899194f11539ef8f37/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:08.627482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.631268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:08.636332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 870/1739] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:08 2022] PUT /identity/v3/projects/1549df946efb4878ad0fc77ebb12adf4/users/e425449746c74f84980c53b32abfe62d/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:08.637459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.755999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fdad-49a7-4cbe-ac48-c094fc7d35c3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.761064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:08.761890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.762215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.762498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.763167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:08.765660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47b59d-f2a6-4768-be9d-1de009c0360e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:08.782822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 871/1740] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:08.787843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:08.794752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:08.794752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:08.869733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] MFA Rules not processed for user `e425449746c74f84980c53b32abfe62d`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:08.871315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:08.927347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df93c8-75c7-45ea-92fb-c52147109a08 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:08.970562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 872/1741] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:08.972747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:08.974467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.099681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:09.117475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7221b-89c3-4b37-abaf-e3b4a22d9cb0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.132869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.135571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693dc93918d433cad9dd1cc34faf4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80723cd4c57144289b165b972ecc2d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.135850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.136213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.136322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.136495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.136849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.136950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.137580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:09.138100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.140821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.140978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.170551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 870/1742] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 544 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:09.171575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.186851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101602db-4b54-407a-aa70-dfed0a0e3f01 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.192791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.193760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.194219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.194656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] PATH_INFO: `/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7/users/d352b03d267643899194f11539ef8f37/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.197564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63233c9dfed64bc99dce773c2a8d3ed7, user_id=d352b03d267643899194f11539ef8f37, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.200864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.244138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 871/1743] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:09 2022] PUT /identity/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7/users/d352b03d267643899194f11539ef8f37/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:09.246426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.255004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.293137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.296079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.340060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 873/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:09.345122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.361149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003a49e9-ade7-4b4c-a549-c777503a206f service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.457266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388bad1-c2ba-41a3-8c1a-30eead20ecf3 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.471349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.472568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.473057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.473497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.477308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.512259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.513167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.514658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.514658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.514658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.517139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ea3d5-a7bd-43fe-ad5f-6d53c287327b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.521168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.528486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.565434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 872/1745] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:09.567329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:09.657102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 874/1746] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:09 2022] POST /identity/v3/projects => generated 355 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:09.658314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.658602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.658875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.734800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] MFA Rules not processed for user `d352b03d267643899194f11539ef8f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:09.737861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:09.803272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d6dbe-9131-41f2-8033-80771288344b service placement] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:09.957711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693dc93918d433cad9dd1cc34faf4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80723cd4c57144289b165b972ecc2d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:09.961505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:09.963119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:09.964239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:09.972828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:09.972828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c177-c6ed-42cc-b4c5-4de557ed4f75 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:09.996958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 875/1747] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:09 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:10.010015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.157187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 873/1748] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:09 2022] POST /identity/v3/projects => generated 354 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:10.160233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.160578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.161002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.200996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883bd11-1ea4-41df-8377-f90ecba7a653 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.230952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] MFA Rules not processed for user `91941658f2aa4a2a84c67a49fdfca8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:10.235357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:10.348021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.348801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.349075 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.349349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.365117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.374539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.385722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 874/1749] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:10.386793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.390134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:10.532576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7aefa5-ee62-474a-a412-230a3c066448 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.536361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.537084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.537901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.538774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.585992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 876/1750] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:09 2022] POST /identity/v3/users => generated 284 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:10.587124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.622954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.624832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.673219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 875/1751] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:10 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:10.675524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.700618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973efab-88a0-4eb2-9e21-42f742099433 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.714987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.715617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.721071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.721071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.721071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.721071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.762176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 876/1752] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:10.767048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:10.787398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290b725-e9fc-4536-bba3-2a442d2c926a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.800908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.801742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.802127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.802503 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] PATH_INFO: `/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4/users/ca08ebd3d00544bc8ec67ac153e1338b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.810830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f7e4f-1d10-4236-88e1-9a29cd9ed634 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:10.831878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693dc93918d433cad9dd1cc34faf4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80723cd4c57144289b165b972ecc2d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:10.832624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:10.834495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:10.840024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:10.840515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:10.841252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.846163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.849560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf9e64f61e4fafacf8a5b12b8522c4, user_id=ca08ebd3d00544bc8ec67ac153e1338b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:10.856704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:10.878015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 877/1753] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:10.993639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 877/1754] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:10 2022] PUT /identity/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4/users/ca08ebd3d00544bc8ec67ac153e1338b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:10.994346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.000600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.039711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beae54a-c2a2-426b-a21b-ece6aca0f8dc tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.092305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:11.205384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf4631-8afb-478a-a55b-1c5a0fe9d9a5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.216411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4693dc93918d433cad9dd1cc34faf4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '80723cd4c57144289b165b972ecc2d2d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.217503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.218072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.218844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] PATH_INFO: `/v3/projects/b76a103869ad46868f0251765953659e` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.220764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b76a103869ad46868f0251765953659e)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.225236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.225740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.226543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.226835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.227115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.227789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.229484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.255718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 878/1755] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:11.256792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.283700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db08c0-688a-4586-b492-5f3ecac24a3a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.303094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.304334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.304625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.310263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] PATH_INFO: `/v3/users/305378661c234ce99065ac7cf78717c1` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.310263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=305378661c234ce99065ac7cf78717c1)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.310263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.371353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:11.411522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76a103869ad46868f0251765953659e', 'request_id': 'req-b1bf1db9-e375-46d8-a37a-5d53705d10b6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.497883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76a103869ad46868f0251765953659e', 'request_id': 'req-b1bf1db9-e375-46d8-a37a-5d53705d10b6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.507152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76a103869ad46868f0251765953659e', 'request_id': 'req-b1bf1db9-e375-46d8-a37a-5d53705d10b6'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.525937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] The token cache is being invalidate because project b76a103869ad46868f0251765953659e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:11.527775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.530367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.534471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 878/1756] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:10 2022] DELETE /identity/v3/projects/b76a103869ad46868f0251765953659e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:11.535636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:11.538690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:11.642204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '305378661c234ce99065ac7cf78717c1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.642795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '305378661c234ce99065ac7cf78717c1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.643797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '305378661c234ce99065ac7cf78717c1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.720963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '305378661c234ce99065ac7cf78717c1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.757989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1db9-e375-46d8-a37a-5d53705d10b6 tempest-VolumeQuotaClassesTest-1471795380 tempest-VolumeQuotaClassesTest-1471795380-project-admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:11.762435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-11987883-a305-4bf2-a3ee-4ef7cf72cc00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '305378661c234ce99065ac7cf78717c1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:11.770905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:11.771632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.772044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.772178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] PATH_INFO: `/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4/users/ca08ebd3d00544bc8ec67ac153e1338b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.779890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8bf9e64f61e4fafacf8a5b12b8522c4, user_id=ca08ebd3d00544bc8ec67ac153e1338b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:11.782788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51772207-377d-4604-98ad-147dd8861c9d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:11.812930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 879/1757] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:11 2022] PUT /identity/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4/users/ca08ebd3d00544bc8ec67ac153e1338b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:11.830990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.831331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.832009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.832117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 879/1758] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:11 2022] DELETE /identity/v3/users/305378661c234ce99065ac7cf78717c1 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:11.837531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014529-9a56-4336-b430-ad34b16f53b3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:11.837827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014529-9a56-4336-b430-ad34b16f53b3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:11.838113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42014529-9a56-4336-b430-ad34b16f53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:11.888569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-42014529-9a56-4336-b430-ad34b16f53b3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:11.890381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-42014529-9a56-4336-b430-ad34b16f53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:11.916932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] MFA Rules not processed for user `ca08ebd3d00544bc8ec67ac153e1338b`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:11.919000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.014843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 880/1759] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:12.016567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.016945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.017292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.040477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] MFA Rules not processed for user `e9e1efb821884a09a39371bc5b792a83`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:12.051841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.073545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 880/1760] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:12.073545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.075507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.215506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 881/1761] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:12.217249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.219221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.311801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e063cd-bc7a-4848-be87-05051b36b681 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.316612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9293f-d553-4fe5-ad93-ffab7f2278eb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.318245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.319296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.319787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.320195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.325477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.325477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.325477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.325901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.333739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.336071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.349414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.351424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.351671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 882/1762] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:12.377884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 881/1763] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:12.854053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.855549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:12.885846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:12.888372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f76691-2f5d-4088-9849-2d89431b7dc9 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.902948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b5e40-604e-40a7-931e-9b1c4b9e0a4d service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:12.904877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.905557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.905756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.906302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] PATH_INFO: `/v3/users/75f8666bdc664053adfe87e54eab3f49` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.908374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f8666bdc664053adfe87e54eab3f49)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:12.912580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:12.928057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:12.928057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:12.928057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:12.928057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:12.928586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.081858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.083015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6ca97-e956-45bb-80eb-e790d1f1b54e service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.095409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 882/1764] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:13.214043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f8666bdc664053adfe87e54eab3f49'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.214842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f8666bdc664053adfe87e54eab3f49'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.217353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f8666bdc664053adfe87e54eab3f49'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.368325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f8666bdc664053adfe87e54eab3f49'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.381154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f8666bdc664053adfe87e54eab3f49'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:13.408187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 883/1765] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:12 2022] DELETE /identity/v3/users/75f8666bdc664053adfe87e54eab3f49 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:13.412420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.413038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.413978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.456861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:13.458415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.475950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:13.562111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 883/1766] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:13.590631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.593047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.731577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfb6e7-21dc-4f0a-a913-ab83ab1017e6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.735866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.736492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.736798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.737064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.757557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.758943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:13.772059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 884/1767] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:13.817433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:13.826469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:13.884319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02052e61-db66-49eb-b2da-dec5d887c41d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:13.896934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:13.899360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:13.899824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:13.900260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] PATH_INFO: `/v3/projects/21be702c65444aeba06ae80cc2a18715` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:13.902792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21be702c65444aeba06ae80cc2a18715)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:13.912741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:14.137406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21be702c65444aeba06ae80cc2a18715', 'request_id': 'req-05fd994e-767c-41d1-b599-307a2a2c49f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.234364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21be702c65444aeba06ae80cc2a18715', 'request_id': 'req-05fd994e-767c-41d1-b599-307a2a2c49f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.244057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21be702c65444aeba06ae80cc2a18715', 'request_id': 'req-05fd994e-767c-41d1-b599-307a2a2c49f9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.288347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] The token cache is being invalidate because project 21be702c65444aeba06ae80cc2a18715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:14.288649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.291740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.298414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 884/1768] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:13 2022] DELETE /identity/v3/projects/21be702c65444aeba06ae80cc2a18715 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:14.299512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:14.318120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932c10-1f40-405f-b2d6-76769efc8410 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:14.372601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:14.451130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:14.452456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:14.453026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:14.453559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] PATH_INFO: `/v3/users/d352b03d267643899194f11539ef8f37` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:14.455785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d352b03d267643899194f11539ef8f37)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:14.459798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:14.742689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd352b03d267643899194f11539ef8f37'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.744154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd352b03d267643899194f11539ef8f37'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.746047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd352b03d267643899194f11539ef8f37'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.822233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:14.823785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:14.847771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd994e-767c-41d1-b599-307a2a2c49f9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:14.851713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:14.852992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:14.854820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:14.855348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] PATH_INFO: `/v3/projects/b3cf1834e8764257addcde1a5df0c9c3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:14.857709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cf1834e8764257addcde1a5df0c9c3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:14.860298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:14.863052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd352b03d267643899194f11539ef8f37'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.911156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd352b03d267643899194f11539ef8f37'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:14.957588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 885/1769] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:14 2022] DELETE /identity/v3/users/d352b03d267643899194f11539ef8f37 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:15.084273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cf1834e8764257addcde1a5df0c9c3', 'request_id': 'req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.213257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cf1834e8764257addcde1a5df0c9c3', 'request_id': 'req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.221736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cf1834e8764257addcde1a5df0c9c3', 'request_id': 'req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.255709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] The token cache is being invalidate because project b3cf1834e8764257addcde1a5df0c9c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:15.257314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.259635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8c56fbff-7019-4eb3-bc20-4cb89a0bb0f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.262412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 885/1770] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:14 2022] DELETE /identity/v3/projects/b3cf1834e8764257addcde1a5df0c9c3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:15.266884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:15.275108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:15.443221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3a6e-43eb-4716-999b-3debbc21d1a1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:15.589396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:15.590059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:15.590378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:15.590603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] PATH_INFO: `/v3/users/4693dc93918d433cad9dd1cc34faf4cc` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:15.591887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4693dc93918d433cad9dd1cc34faf4cc)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:15.594068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:15.676945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:15.892754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab983e-4501-4064-9ee7-b213af112e88 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:15.893505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab983e-4501-4064-9ee7-b213af112e88 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:15.894105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab983e-4501-4064-9ee7-b213af112e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:15.926492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4693dc93918d433cad9dd1cc34faf4cc'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.928046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4693dc93918d433cad9dd1cc34faf4cc'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:15.929562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4693dc93918d433cad9dd1cc34faf4cc'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.019033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-71ab983e-4501-4064-9ee7-b213af112e88 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:16.021493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-71ab983e-4501-4064-9ee7-b213af112e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.040231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4693dc93918d433cad9dd1cc34faf4cc'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.049975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4693dc93918d433cad9dd1cc34faf4cc'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.146677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 886/1771] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:15 2022] DELETE /identity/v3/users/4693dc93918d433cad9dd1cc34faf4cc => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:16.151103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.153862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.192962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 886/1772] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:56:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:16.319272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1808ba6-69c1-4b9f-930b-4b8119675f4d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.325229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.326260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.326671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.327101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] PATH_INFO: `/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.329523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=63233c9dfed64bc99dce773c2a8d3ed7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:16.331135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:16.515972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63233c9dfed64bc99dce773c2a8d3ed7', 'request_id': 'req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.527443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63233c9dfed64bc99dce773c2a8d3ed7', 'request_id': 'req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.534493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63233c9dfed64bc99dce773c2a8d3ed7', 'request_id': 'req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.688591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] The token cache is being invalidate because project 63233c9dfed64bc99dce773c2a8d3ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:16.688979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.690569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:16.692321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 887/1773] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:16 2022] DELETE /identity/v3/projects/63233c9dfed64bc99dce773c2a8d3ed7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:16.697513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021dfd-09c5-425d-aeb4-47aa78824217 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.698127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021dfd-09c5-425d-aeb4-47aa78824217 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.698595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021dfd-09c5-425d-aeb4-47aa78824217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.715209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:16.717799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.772450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-95021dfd-09c5-425d-aeb4-47aa78824217 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:16.772450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-95021dfd-09c5-425d-aeb4-47aa78824217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:16.956892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 887/1774] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:16.964290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.964860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.965416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.979395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c044d-8d85-4454-ae6d-a11a7e4f93ee admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:16.986072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:16.987468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:16.987688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:16.987965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:16.990199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:17.016013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:17.017614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:17.031908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 888/1775] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:17.036109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.048952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694da1c-cfaf-4254-8f72-b26608bbf46d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.057608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.058577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.059006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.059473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.060533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:17.061102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.063080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.081690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 889/1776] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:17.091082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.126199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.128020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.136453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a014b-139f-4d9d-ba7a-9f64b6ac1c68 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.140034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 888/1777] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:56:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:56:17.172332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.172332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.172332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.172332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.172949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.172949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.397637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 890/1778] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:17 2022] POST /identity/v3/projects => generated 371 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:17.401927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.445029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4f9ac-f358-4eb6-b2d7-5c85d8e32532 service swift] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.588042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.589616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.590431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.590909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.592369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.613900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:17.682295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.867939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 889/1779] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:17 2022] POST /identity/v3/users => generated 286 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:17.868655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:17.887094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c0c1f3-d41c-4d3b-93af-7ea4188f4681 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:17.898466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:17.899528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:17.900328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:17.900783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:17.901212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:17.902021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:17.904981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:17.956222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 891/1780] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:17.959121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.000449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affee2b-dc90-4cd8-a849-3046c84e3932 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:18.054428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:18.057683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.058190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.066578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.070308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:18.080842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8481d3e-423a-4eef-bb78-d5b49bf38bfc admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:18.148803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 890/1781] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:18.153544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.168622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdaeab6-a3e0-4247-b6b5-33d39d95d7f6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:18.184310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:18.185936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.186533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.186960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] PATH_INFO: `/v3/projects/09510acc07574d80a42790205ecb31d9/users/8f4ba9774cb144dba921e53590316a96/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.219114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09510acc07574d80a42790205ecb31d9, user_id=8f4ba9774cb144dba921e53590316a96, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:18.223596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:18.354906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 892/1782] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:18 2022] PUT /identity/v3/projects/09510acc07574d80a42790205ecb31d9/users/8f4ba9774cb144dba921e53590316a96/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:18.373381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:18.374056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:18.374514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:18.509587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] MFA Rules not processed for user `8f4ba9774cb144dba921e53590316a96`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:18.520779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:18.688793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 891/1783] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:18.693158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.785909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:18.788672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:19.041335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2cd14-ecc4-4ed4-b8ea-9e2855e99829 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:19.072462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:19.073344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.073626 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.074667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] PATH_INFO: `/v3/projects/80723cd4c57144289b165b972ecc2d2d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.091443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80723cd4c57144289b165b972ecc2d2d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:19.095650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:19.108490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879de76a-25a4-4c7a-8a22-5a27c7e3d9fc admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:19.127568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:19.128613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.129067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.129494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.130147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:19.132958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4cb115-a316-4e34-abec-f9c9296c5072 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:19.269993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 893/1784] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:18 2022] POST /identity/v3/projects => generated 373 bytes in 578 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:19.271514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965aa3-3987-4c17-b512-b4c388bd8be0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.271933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965aa3-3987-4c17-b512-b4c388bd8be0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.272472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9965aa3-3987-4c17-b512-b4c388bd8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.318558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80723cd4c57144289b165b972ecc2d2d', 'request_id': 'req-7f85a89a-8063-43f9-abae-1a260653fcf6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.330465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80723cd4c57144289b165b972ecc2d2d', 'request_id': 'req-7f85a89a-8063-43f9-abae-1a260653fcf6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.364399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80723cd4c57144289b165b972ecc2d2d', 'request_id': 'req-7f85a89a-8063-43f9-abae-1a260653fcf6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.374492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b9965aa3-3987-4c17-b512-b4c388bd8be0 None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:19.383098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b9965aa3-3987-4c17-b512-b4c388bd8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:19.522828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] The token cache is being invalidate because project 80723cd4c57144289b165b972ecc2d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:19.523171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.524831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:19.527987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 892/1785] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:18 2022] DELETE /identity/v3/projects/80723cd4c57144289b165b972ecc2d2d => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:19.532943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:19.540146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:19.554714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:19.617143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 894/1786] 10.222.0.88 () {58 vars in 1015 bytes} [Wed Aug 24 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:19.620532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.621358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.622684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.690046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:19.691848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:19.803011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85a89a-8063-43f9-abae-1a260653fcf6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:19.836050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:19.836890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:19.837310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:19.837476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:19.838246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:19.840303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e2646-e4a6-4bb6-b79c-8af2c30cbb88 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:19.977608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 895/1787] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:19.979484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:19.981561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:20.008555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79816ffa-9bed-4b57-a74c-495b865027e7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.016490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:20.018970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 893/1788] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:19 2022] POST /identity/v3/users => generated 293 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:20.020841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.023065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.023530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.046557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.047925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.048072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.048472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.069932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.074473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.102625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 896/1789] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:20.104389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:20.104657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.108533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:20.158764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 894/1790] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:20.160652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad319ef-d60d-436d-9c41-b89d22b6b0b2 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.175409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.199365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.200044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.200335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.203396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.204214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.217312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.231919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487749bb-7e25-4167-80e6-7673fe5cf56e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.264525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.265437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.265901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.266333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.267176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:20.267785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.279103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.279295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 897/1791] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:20.284893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.313321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 895/1792] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:20.321769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c31727-912f-419d-957a-64c857276b91 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.323145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.342218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c3cfe-0348-468c-bdc0-91331563575c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.348307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.357162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.358046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.358789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.359998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.362322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.367246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.367510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.367801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] PATH_INFO: `/v3/projects/f6d04ee79b93405797978a370649bbc2/users/a1bf055a0c4b4f0da25ad04c1a5accff/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.371374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.433325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d04ee79b93405797978a370649bbc2, user_id=a1bf055a0c4b4f0da25ad04c1a5accff, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.450272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.512291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 896/1793] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:20.515801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.591018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 898/1794] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:20 2022] PUT /identity/v3/projects/f6d04ee79b93405797978a370649bbc2/users/a1bf055a0c4b4f0da25ad04c1a5accff/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:20.593559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.739938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d057a-a3c5-47d8-bc64-acd0cc08b9fd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.852877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c296f-4a81-4ab7-9b7c-e9977ac9c1b0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.862720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.863267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.863547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.863819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.864483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.866688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.890584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 899/1795] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:20.896403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:20.910048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.913499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.913499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.914224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.918325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.923768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87252d9-e2ca-49e3-aedb-5633ab15dbbf admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:20.928329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.940558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:20.941273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.941641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.941913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] PATH_INFO: `/v3/projects/f6d04ee79b93405797978a370649bbc2/users/a1bf055a0c4b4f0da25ad04c1a5accff/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:20.955430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d04ee79b93405797978a370649bbc2, user_id=a1bf055a0c4b4f0da25ad04c1a5accff, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:20.955589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:20.955670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b476-f151-4d2a-b207-6a8fd252148f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:20.973264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 900/1796] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:20 2022] PUT /identity/v3/projects/f6d04ee79b93405797978a370649bbc2/users/a1bf055a0c4b4f0da25ad04c1a5accff/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:20.988820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:20.989404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:20.989901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.077579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 897/1797] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/users => generated 287 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:21.086377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.168173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fc85-666c-44d0-847b-afda232e1603 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.193562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] MFA Rules not processed for user `a1bf055a0c4b4f0da25ad04c1a5accff`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:21.195036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:21.273759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:21.397084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.401208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.401952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.402604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.405436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.410551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.443445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 898/1798] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:21.449810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.476305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 901/1799] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:21.480742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f4be9-e419-4386-95e3-53a95fe9eb9a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.503423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.503528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.503635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:21.503718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.503718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.503718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.504652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.508665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.551412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 899/1800] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:21.554389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:21.588313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed9dd-7297-4641-889b-5d43bea5d129 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.606970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.608545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.609579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.610732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] PATH_INFO: `/v3/projects/4162476a52114f578aaaf960514492f0/users/5ed726ecbf3b49cc907fe21ee50e7b8f/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.679610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4162476a52114f578aaaf960514492f0, user_id=5ed726ecbf3b49cc907fe21ee50e7b8f, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.682546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.683870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b37468-bf5a-4566-bcc2-bb186677c9c5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:21.707477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:21.708600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.709092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.709655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.736378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:21.739489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c1b30-54fd-45e6-8548-1dfb2ca1f3fd service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:21.767383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 902/1801] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:21.807614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 900/1802] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:21 2022] PUT /identity/v3/projects/4162476a52114f578aaaf960514492f0/users/5ed726ecbf3b49cc907fe21ee50e7b8f/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:21.833521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:21.838219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:21.838219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:21.923711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] MFA Rules not processed for user `5ed726ecbf3b49cc907fe21ee50e7b8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:21.930779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.086617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 903/1803] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:22.116222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:22.118436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:22.304932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c225f3-0561-4ea8-92a9-7f4ba4315742 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:22.315755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:22.320401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:22.320401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:22.320401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:22.340829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:22.345787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486c203-a1a9-4396-84d9-da3f64910e59 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:22.366420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 901/1804] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:22.880454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:23.022305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:23.768892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:24.303984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:24.323584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f226bf-94dc-46a3-b826-156344d1a927 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.324763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f226bf-94dc-46a3-b826-156344d1a927 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.325248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f226bf-94dc-46a3-b826-156344d1a927 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.326885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 902/1805] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:56:24.335049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.335858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.336314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.362215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:24.363942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.503790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b43ee89-c894-4360-bf05-77e38d93848c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:24.514134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:24.516324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.517488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.518205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] PATH_INFO: `/v3/users/8f4ba9774cb144dba921e53590316a96` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.521627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4ba9774cb144dba921e53590316a96)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:24.525755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:24.590953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 903/1806] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:56:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:24.612189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:24.617225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:24.642881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9b3fe-e161-4541-8de7-21b4efbba875 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:24.651590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:24.652273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:24.652596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:24.652882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:24.671702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:24.673641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367d0c-e8f9-4ffe-bab5-180984e42ab5 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:24.707220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:24.727484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 904/1807] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:24.885521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4ba9774cb144dba921e53590316a96'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.887248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4ba9774cb144dba921e53590316a96'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.888857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4ba9774cb144dba921e53590316a96'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:24.906937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4ba9774cb144dba921e53590316a96'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:25.016879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed475002-8dd0-42ad-bdd1-3da87d776f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4ba9774cb144dba921e53590316a96'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:25.032668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc04-a9b5-4ee5-86fe-b5028ef7bc57 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.032983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc04-a9b5-4ee5-86fe-b5028ef7bc57 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.033377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc04-a9b5-4ee5-86fe-b5028ef7bc57 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.034897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 905/1808] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:56:25.156792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 904/1809] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:24 2022] DELETE /identity/v3/users/8f4ba9774cb144dba921e53590316a96 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:25.168535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.168924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.169283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.190610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48583-8996-439d-b254-31655b698822 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.191256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48583-8996-439d-b254-31655b698822 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.191726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf48583-8996-439d-b254-31655b698822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.267463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:25.269207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-edf48583-8996-439d-b254-31655b698822 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:25.271968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-edf48583-8996-439d-b254-31655b698822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:25.273557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:25.444553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 905/1810] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:25.469913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:25.548327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 906/1811] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:25.620496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48583-8996-439d-b254-31655b698822 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:25.625135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-edf48583-8996-439d-b254-31655b698822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:25.799351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf48583-8996-439d-b254-31655b698822 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:25.829261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:25.830875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:25.831353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:25.832039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:25.886850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:25.907604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:25.964745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 906/1812] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:26.259481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:26.261517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:26.299451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1a2dc-a163-45a3-9d20-0181911fa6ac None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:26.308156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:26.314124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:26.314124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:26.314124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:26.325584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:26.330466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:26.358025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 907/1813] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:27.733077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:28.441069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:28.692496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:28.705263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:28.729854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edfb4a-6db8-4953-995d-72375d4bf3ff service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:28.737287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:28.738347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:28.738908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:28.739586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] PATH_INFO: `/v3/users/5ed726ecbf3b49cc907fe21ee50e7b8f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:28.743358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed726ecbf3b49cc907fe21ee50e7b8f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:28.745555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:28.840344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:28.842362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:28.862937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141148f3-4dfb-4fe8-b140-fb516c5eeb01 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:28.877009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:28.878860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:28.879486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:28.880331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] PATH_INFO: `/v3/projects/09510acc07574d80a42790205ecb31d9` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:28.882278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09510acc07574d80a42790205ecb31d9)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:28.884547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:28.943130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed726ecbf3b49cc907fe21ee50e7b8f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:28.944611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed726ecbf3b49cc907fe21ee50e7b8f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:28.946364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed726ecbf3b49cc907fe21ee50e7b8f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:28.963159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed726ecbf3b49cc907fe21ee50e7b8f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:28.995336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d314f6db-000a-4600-8318-3b684c97162b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed726ecbf3b49cc907fe21ee50e7b8f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.104512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 907/1814] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:28 2022] DELETE /identity/v3/users/5ed726ecbf3b49cc907fe21ee50e7b8f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:29.107390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:29.108324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:29.108884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:29.121204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09510acc07574d80a42790205ecb31d9', 'request_id': 'req-bc1a0e9e-bbf8-433d-9232-def33d7212a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.156983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:29.159276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:29.173802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09510acc07574d80a42790205ecb31d9', 'request_id': 'req-bc1a0e9e-bbf8-433d-9232-def33d7212a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.183833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09510acc07574d80a42790205ecb31d9', 'request_id': 'req-bc1a0e9e-bbf8-433d-9232-def33d7212a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.304763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 908/1815] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:29.326474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:29.328369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:29.364399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] The token cache is being invalidate because project 09510acc07574d80a42790205ecb31d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:29.364901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.366181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.391382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 908/1816] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:28 2022] DELETE /identity/v3/projects/09510acc07574d80a42790205ecb31d9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:29.394062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:29.403576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:29.467823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5714d6-a2e7-4861-8d7b-69a26e2e79cb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:29.486630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:29.487320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:29.487894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:29.488003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:29.490149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:29.521398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:29.523662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:29.542894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 909/1817] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:29.627637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a0e9e-bbf8-433d-9232-def33d7212a6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:29.656617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:29.659125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:29.659943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:29.661351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] PATH_INFO: `/v3/users/a1bf055a0c4b4f0da25ad04c1a5accff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:29.664347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1bf055a0c4b4f0da25ad04c1a5accff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:29.671267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:29.935102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1bf055a0c4b4f0da25ad04c1a5accff'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.936195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1bf055a0c4b4f0da25ad04c1a5accff'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:29.936360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1bf055a0c4b4f0da25ad04c1a5accff'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:30.005573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1bf055a0c4b4f0da25ad04c1a5accff'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:30.027831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1bf055a0c4b4f0da25ad04c1a5accff'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:30.100434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 909/1818] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:29 2022] DELETE /identity/v3/users/a1bf055a0c4b4f0da25ad04c1a5accff => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:30.363103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:30.488004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:31.013585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.022088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988b9-d6a3-4893-b217-eb44c291ca3a service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.207476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.209594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.210777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.211540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] PATH_INFO: `/v3/projects/f6d04ee79b93405797978a370649bbc2` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.213792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d04ee79b93405797978a370649bbc2)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.216485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:31.392621 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.396200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.414437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54e17d-bf08-43b9-a969-036f521bab0d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.439875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d04ee79b93405797978a370649bbc2', 'request_id': 'req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.503929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.506363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.506363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.506363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] PATH_INFO: `/v3/projects/4162476a52114f578aaaf960514492f0` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.506715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4162476a52114f578aaaf960514492f0)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.508839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:31.566035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d04ee79b93405797978a370649bbc2', 'request_id': 'req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.589151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d04ee79b93405797978a370649bbc2', 'request_id': 'req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.594578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] The token cache is being invalidate because project f6d04ee79b93405797978a370649bbc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:31.594578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.594578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-fcb4c9ea-81f4-4188-9d56-1cdadf6e9b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.596545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 910/1819] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:31 2022] DELETE /identity/v3/projects/f6d04ee79b93405797978a370649bbc2 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:31.601471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0ec5-9204-490b-90bb-6e050e10d39d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.601757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0ec5-9204-490b-90bb-6e050e10d39d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.602029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a0ec5-9204-490b-90bb-6e050e10d39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.626723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d98a0ec5-9204-490b-90bb-6e050e10d39d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:31.628031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d98a0ec5-9204-490b-90bb-6e050e10d39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.650023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 911/1820] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:31.656772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.657325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.657606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.683989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:31.685283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.694553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4162476a52114f578aaaf960514492f0', 'request_id': 'req-6d49cf90-1a27-4c1d-a18e-99676128dd03'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.703506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4162476a52114f578aaaf960514492f0', 'request_id': 'req-6d49cf90-1a27-4c1d-a18e-99676128dd03'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.711616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4162476a52114f578aaaf960514492f0', 'request_id': 'req-6d49cf90-1a27-4c1d-a18e-99676128dd03'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.781176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 912/1821] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:31.784123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.797385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa90c2-bb85-4542-a719-8002ff609016 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.803902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.804537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.804845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.805121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.805844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:31.806150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.807770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b038246-ca08-484e-bed5-e3016179c911 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:31.819025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] The token cache is being invalidate because project 4162476a52114f578aaaf960514492f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:31.819368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.821892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:31.823647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 910/1822] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:31 2022] DELETE /identity/v3/projects/4162476a52114f578aaaf960514492f0 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:31.824250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 913/1823] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:31.825206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.828828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30a66-b610-4304-afc0-09063c7ce10b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.829242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30a66-b610-4304-afc0-09063c7ce10b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.829694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc30a66-b610-4304-afc0-09063c7ce10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.832938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.847921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49cf90-1a27-4c1d-a18e-99676128dd03 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.855920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.856796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.857096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.857445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.858164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.858320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4cc30a66-b610-4304-afc0-09063c7ce10b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:31.859559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4cc30a66-b610-4304-afc0-09063c7ce10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.860529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:31.869247 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 914/1824] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:31.877165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.878669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.878669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.908488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:31.911674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:31.921983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 915/1825] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:31.927010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.937614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f1b0e-7f37-475f-acbf-3343f4101628 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.944039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.944934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.945418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.945866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.948757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:31.949246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.951492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:31.972941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 916/1826] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:31.974899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:31.987320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32a291-6dbc-4c07-9be7-ad892530ae99 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:31.993059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:31.993767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:31.994120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:31.994538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:31.995251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:31.997546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.053694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 911/1827] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:32.055151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.114890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 917/1828] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:31 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:32.119907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.215417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4162da18-03dc-4e58-989c-78725b36fd6a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.220275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ee2fa-cb87-4717-9e5f-7978832c75dc admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.221424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.222168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.222826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.223193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.224214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.228293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.230419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.231649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.231649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.231834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.232461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.234698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.342946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 912/1829] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:32 2022] POST /identity/v3/users => generated 292 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:32.347635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.359150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b6017-5b16-433e-ad71-20419d93b27c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.363968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.364579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.364884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.365649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.366664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.368470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.392135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 913/1830] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:32.393568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.404459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6721623-5e5d-43fd-8914-87720a5cb5ce admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.409278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.409824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.410103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.410375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.411018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.412869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.423922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 914/1831] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:32.433496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.444839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ec8a5-508f-4149-bcd2-8de676f5b400 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.449550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.450751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.451441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.452141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] PATH_INFO: `/v3/projects/35893bef105348ecbd0a5fc6285a07fe/users/0027977a988645b5816770c73840168c/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.457629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 918/1832] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:32 2022] POST /identity/v3/users => generated 288 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:32.461960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.469339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=35893bef105348ecbd0a5fc6285a07fe, user_id=0027977a988645b5816770c73840168c, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.472082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32199687-3709-4f96-96a4-f85f30e13d2e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.477073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cf0f9-1333-45d6-87d5-149c4a66f3bc admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.483648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.484406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.484683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.485008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.485791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.487450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.501857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 919/1833] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:32.506439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.517035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df56227-771b-467c-873b-d3f53166c51c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.522495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.523102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.523380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.523653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.524314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.525986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.538186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 920/1834] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:32.543899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.559674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745494ad-8ec4-4729-938c-a19b02aff890 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.559916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.560548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.560874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.561148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] PATH_INFO: `/v3/projects/8b425c683fcb4ed98ac18461fa603980/users/fb5cde0db18c4cffa00fe6eef9cf7b73/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.573139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 915/1835] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:32 2022] PUT /identity/v3/projects/35893bef105348ecbd0a5fc6285a07fe/users/0027977a988645b5816770c73840168c/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:32.578375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b425c683fcb4ed98ac18461fa603980, user_id=fb5cde0db18c4cffa00fe6eef9cf7b73, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.581259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.586068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cde9-d0ec-4b8d-b510-ebe686777411 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.586355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cde9-d0ec-4b8d-b510-ebe686777411 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.586637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1cde9-d0ec-4b8d-b510-ebe686777411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.619792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cdc1cde9-d0ec-4b8d-b510-ebe686777411 None None] MFA Rules not processed for user `0027977a988645b5816770c73840168c`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:32.621784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cdc1cde9-d0ec-4b8d-b510-ebe686777411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:32.714224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 921/1836] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:32 2022] PUT /identity/v3/projects/8b425c683fcb4ed98ac18461fa603980/users/fb5cde0db18c4cffa00fe6eef9cf7b73/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:32.714442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 916/1837] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:32.722234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.723062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.723558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.725123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.730445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:32.756519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] MFA Rules not processed for user `fb5cde0db18c4cffa00fe6eef9cf7b73`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:32.759182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:32.800204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bdd331-2ee9-448a-a56b-ec98a35e4c7f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.806084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.806811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.807032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.807308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.838199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 917/1838] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:32.843116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.900645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.902169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.911614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 922/1839] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:32.919077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcf95e-691e-4b53-8e08-4b4f6781c6e1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.923756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.924439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.924804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.925204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.925848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.928473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:32.933805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:32.946955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9cf99-3682-4671-baec-e10e1ecc80a2 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:32.951605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:32.952287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:32.952562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:32.952864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] PATH_INFO: `/v3/users/0027977a988645b5816770c73840168c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:32.954025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0027977a988645b5816770c73840168c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:32.955939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.017604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:33.025095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 918/1840] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:32 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:33.029121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.104846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344fab4-87f7-4514-84b5-a480e29031de admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.106777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.107400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.107682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.107956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.108597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.110601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.235433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0027977a988645b5816770c73840168c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:33.238423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0027977a988645b5816770c73840168c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:33.239095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0027977a988645b5816770c73840168c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:33.248261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0027977a988645b5816770c73840168c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:33.263244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:33.283937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 919/1841] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:33 2022] POST /identity/v3/users => generated 288 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:33.284739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0027977a988645b5816770c73840168c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:33.284832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.284832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:33.312782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e37c-80b8-4b5a-b33d-80feb63c8a6e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.321993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.323014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.323599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.324191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.325494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.327260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.344931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 920/1842] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:33.349741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.368428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58167b96-e967-4d2f-98cd-459618e1ae52 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.379326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.380469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.382451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.383480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.385117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.387507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8feffa-537d-44de-b817-147ba286a18f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.405431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 921/1843] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:33.417167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 923/1844] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:32 2022] DELETE /identity/v3/users/0027977a988645b5816770c73840168c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:33.423913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.423913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.423913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.438070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.489179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:33.490666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:33.551137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e49f3-9815-4461-967b-9391d7f56f91 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.557875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.558771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.559114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.559440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] PATH_INFO: `/v3/projects/3063079432534ee2a09105c912258056/users/2ee32cf8f7dd46049dae30231785fd06/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.578106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3063079432534ee2a09105c912258056, user_id=2ee32cf8f7dd46049dae30231785fd06, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.580930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e92ecc-9302-45cc-9de1-d015a0e29504 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.600357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 922/1845] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:33.610872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.621466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:33.674095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fad54-b1bb-4928-b885-8400d86dad22 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.678529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.679585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.680063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.680493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.693727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 924/1846] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:33 2022] PUT /identity/v3/projects/3063079432534ee2a09105c912258056/users/2ee32cf8f7dd46049dae30231785fd06/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:33.695324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.698221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:33.713009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.713522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.713794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.714758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 923/1847] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:33.750072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] MFA Rules not processed for user `2ee32cf8f7dd46049dae30231785fd06`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:33.751501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:33.838410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 925/1848] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:33.843025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:33.855127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c56b-6f5d-4e36-b191-92b7cf9653fb service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:33.922328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:33.922949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:33.923229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:33.923497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:33.924136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:33.926171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.063039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 924/1849] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:33 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:34.070112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.092940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45cf71-5ac4-4a61-8498-4f083d8a00c7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.195356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.196033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.196319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.196589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.197413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.199420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.321387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.323051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 926/1850] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:34 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:34.323691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:34.327106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.338511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a731a4c-8f0d-40df-ad0f-ea2159fb39ef admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.344989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.346200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.346419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.346689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] PATH_INFO: `/v3/projects/35893bef105348ecbd0a5fc6285a07fe` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.348935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35893bef105348ecbd0a5fc6285a07fe)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.352308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.362658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d9b9e-d9a7-4215-9e1f-312010152cc4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.377324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.377992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.378487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.378767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.379431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.381789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.396181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 927/1851] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:34.401941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.421040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4141da-00e6-4467-9516-38eb1172dda7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.428797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.429491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.429868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.430153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] PATH_INFO: `/v3/projects/0d6038c3f6a6469596d0585ffa34fea7/users/47fa80ca00d24f8c8f717ba4bb1bdc75/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.461628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6038c3f6a6469596d0585ffa34fea7, user_id=47fa80ca00d24f8c8f717ba4bb1bdc75, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.465085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.609966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 928/1852] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:34 2022] PUT /identity/v3/projects/0d6038c3f6a6469596d0585ffa34fea7/users/47fa80ca00d24f8c8f717ba4bb1bdc75/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:34.611400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.623973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35893bef105348ecbd0a5fc6285a07fe', 'request_id': 'req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:34.633249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35893bef105348ecbd0a5fc6285a07fe', 'request_id': 'req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:34.647315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35893bef105348ecbd0a5fc6285a07fe', 'request_id': 'req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:34.707230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f104a3-65e0-42dd-86b1-92c7a2f5f321 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.782452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.783162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.783519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.783879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.784905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.786747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.797106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] The token cache is being invalidate because project 35893bef105348ecbd0a5fc6285a07fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:34.797801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:34.798885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-b9a4ab2a-f4aa-4f2f-bc48-1c19b1825878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:34.800888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 925/1853] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:34 2022] DELETE /identity/v3/projects/35893bef105348ecbd0a5fc6285a07fe => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:34.804952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 929/1854] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:34.806769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f8fe-63e3-404f-85aa-336af3a30627 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.806913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.807054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f8fe-63e3-404f-85aa-336af3a30627 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.807455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0f8fe-63e3-404f-85aa-336af3a30627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.811243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:34.829660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3706c97-a45c-4703-9bc5-e65c41f3e1c4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.831695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-82a0f8fe-63e3-404f-85aa-336af3a30627 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:34.838241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-82a0f8fe-63e3-404f-85aa-336af3a30627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:34.838403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.838403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.838403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.838652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] PATH_INFO: `/v3/projects/0d6038c3f6a6469596d0585ffa34fea7/users/47fa80ca00d24f8c8f717ba4bb1bdc75/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.840385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6038c3f6a6469596d0585ffa34fea7, user_id=47fa80ca00d24f8c8f717ba4bb1bdc75, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:34.843118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efb06b-0b22-4557-842f-fb1254475a30 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:34.845622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 926/1855] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:34.860453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 930/1856] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:34 2022] PUT /identity/v3/projects/0d6038c3f6a6469596d0585ffa34fea7/users/47fa80ca00d24f8c8f717ba4bb1bdc75/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:34.862678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.862966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.863244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.866042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.866343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.866603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:34.884520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:34.885785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:34.898254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] MFA Rules not processed for user `47fa80ca00d24f8c8f717ba4bb1bdc75`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:34.898254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:34.967091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 927/1857] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:34.971452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:34.984138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad78907-974e-42ed-8960-a4cc5e1af48e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:34.992854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 931/1858] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:34.997755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:34.998395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:34.998676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:34.998950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.000420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:35.000420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.001310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.001921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.002832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:35.022311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 928/1859] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:35.023262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.033590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6b300-cc7f-4ad0-9d2b-f5070518df4f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.038983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.039594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.039866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.040131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.040793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.042729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.075003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227881b-b2f9-43aa-9676-37e5ab3874f5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.078981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.080321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:35.082390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.082694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.082970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.085898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:35.172946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 929/1860] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:35 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:35.177231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.200123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.201642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.212491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 932/1861] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:35.280623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04edbc8-5478-4774-aa15-f877ad1d15bf admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.289659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.290382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.290745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.291109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.291822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.294505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.397601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 930/1862] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:35 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:35.411913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.424345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804911f8-635f-49df-9d59-f3c6eec89c07 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.429821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.430471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.430747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.431019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.431668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.437031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.446787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 933/1863] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:35.451054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.462613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2565ba-4cde-448d-85d2-e48266683192 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.467370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.467987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.468269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.468566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.469254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.470890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397d623-c774-4514-bf02-5d80c058eefe admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.504307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 931/1864] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:35.507295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.526338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5fad2-3b65-4075-8fec-ec32a9ca30b4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.533368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.533987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.534275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.534552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] PATH_INFO: `/v3/projects/60ae41b8e6b84e5da94ba56045338924/users/7409fa97903f4e58a4bf6204cc4f9632/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.552987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ae41b8e6b84e5da94ba56045338924, user_id=7409fa97903f4e58a4bf6204cc4f9632, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.555968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:35.657213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:35.731676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 934/1865] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:35 2022] PUT /identity/v3/projects/60ae41b8e6b84e5da94ba56045338924/users/7409fa97903f4e58a4bf6204cc4f9632/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:35.743076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.743819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.743819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.780778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] MFA Rules not processed for user `7409fa97903f4e58a4bf6204cc4f9632`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:35.782043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:35.876606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 932/1866] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:35.881501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:35.979146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc8193-68c2-413e-a350-81d3c30a625e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:35.991940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:35.992663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:35.992971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:35.993266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:35.993940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:35.996128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.048633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.051832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:36.069042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f335b1-f62b-4b1b-bf61-c8651c23df81 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.076757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.076757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.076757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.076757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] PATH_INFO: `/v3/users/772d57a2b9a44aebb5e05f7a52527ff2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.090360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=772d57a2b9a44aebb5e05f7a52527ff2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.092123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.180523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 935/1867] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:35 2022] POST /identity/v3/projects => generated 375 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:36.184370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.261952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91354ce-feab-45ce-bb64-ecb35ff40a49 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.267712 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.268325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.268602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.268905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.269542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.272017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.452264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 936/1868] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:36 2022] POST /identity/v3/users => generated 294 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:36.458566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.466767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772d57a2b9a44aebb5e05f7a52527ff2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:36.467702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772d57a2b9a44aebb5e05f7a52527ff2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:36.468871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772d57a2b9a44aebb5e05f7a52527ff2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:36.489831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7154412-897e-4d3f-96cf-381700ed9dd9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.497074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.497872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.498158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.498434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.499142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.501376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.520691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 937/1869] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:36.526848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.529393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:36.548992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772d57a2b9a44aebb5e05f7a52527ff2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:36.559536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b194f7-803a-411d-a85b-cfd4b17fc994 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.559840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b52fd41-1c13-4858-80f9-02b59dc773cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772d57a2b9a44aebb5e05f7a52527ff2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:36.566234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.566969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.567959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.569499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] PATH_INFO: `/v3/projects/450fb447e07b450db50842a0d55a6bb5/users/8e847408fea3402aaa5fb245edc2c2ee/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.586814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 933/1870] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:36 2022] DELETE /identity/v3/users/772d57a2b9a44aebb5e05f7a52527ff2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:36.589861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fb447e07b450db50842a0d55a6bb5, user_id=8e847408fea3402aaa5fb245edc2c2ee, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.591711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.591879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.592360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.592868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.615472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:36.617080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:36.695988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 934/1871] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:36.713206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.715366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:36.737225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 938/1872] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:36 2022] PUT /identity/v3/projects/450fb447e07b450db50842a0d55a6bb5/users/8e847408fea3402aaa5fb245edc2c2ee/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:36.738733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.815929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20b601-f6c5-4e5e-a8bf-111622722991 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.827405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9536b-c263-488f-bb5b-358e2225a52c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.835881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.836586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.836911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.837529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.837848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.839556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.853361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 939/1873] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:36.856648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:36.874399 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5f196-8b67-46db-9572-cf2dd8a5b7d5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:36.888619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.889371 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.889657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.889940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] PATH_INFO: `/v3/projects/450fb447e07b450db50842a0d55a6bb5/users/8e847408fea3402aaa5fb245edc2c2ee/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.892605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=450fb447e07b450db50842a0d55a6bb5, user_id=8e847408fea3402aaa5fb245edc2c2ee, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.897438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73217d2f-f7e4-4452-b1dd-e3a7841cd3bd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.901213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:36.902207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.902673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.903151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.910485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 940/1874] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:36 2022] PUT /identity/v3/projects/450fb447e07b450db50842a0d55a6bb5/users/8e847408fea3402aaa5fb245edc2c2ee/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:36.921366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:36.928560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:36.928750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:36.928750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:36.928750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:36.937654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 935/1875] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:36.982411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] MFA Rules not processed for user `8e847408fea3402aaa5fb245edc2c2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:36.984333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.102316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 941/1876] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:37.116866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:37.120305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.196195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9cb9c-6019-45d5-a8b0-323fa51d801b service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:37.246876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:37.247494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:37.247771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:37.248037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:37.249965 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.323956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:37.325481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:37.336688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 936/1877] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:37.642267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:37.643794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:37.752748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df7930-89ab-43f8-998d-2b22665afacb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:37.758626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:37.759300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:37.759626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:37.759900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] PATH_INFO: `/v3/projects/4de7c4b1b167433e9367d8bffe2daf53` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:37.761535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de7c4b1b167433e9367d8bffe2daf53)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:37.764536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:37.868973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:37.989374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de7c4b1b167433e9367d8bffe2daf53', 'request_id': 'req-7151b885-1984-4c6c-b6f4-0d93c00c1f36'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.061839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.063317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.082257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad77adf-a2d1-4c03-b289-5c0fe60d2781 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.148376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.149055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.149333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.149606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.151515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.171179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de7c4b1b167433e9367d8bffe2daf53', 'request_id': 'req-7151b885-1984-4c6c-b6f4-0d93c00c1f36'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.179150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de7c4b1b167433e9367d8bffe2daf53', 'request_id': 'req-7151b885-1984-4c6c-b6f4-0d93c00c1f36'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.186133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:38.195759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] The token cache is being invalidate because project 4de7c4b1b167433e9367d8bffe2daf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:38.196073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.196951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.201797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 942/1878] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:37 2022] DELETE /identity/v3/projects/4de7c4b1b167433e9367d8bffe2daf53 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:38.202873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.204537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.264887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.266890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7302bc0-d544-4a6b-a6bf-54bc4adce60e service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.278977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 937/1879] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:38.305844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151b885-1984-4c6c-b6f4-0d93c00c1f36 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.314420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.314679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.314882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.315215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] PATH_INFO: `/v3/users/905a113198b04007804e56bc71cc77e5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.317852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=905a113198b04007804e56bc71cc77e5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.322541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.408547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbd54-8300-4bfd-b6bb-dd9b2187b6b9 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.408951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbd54-8300-4bfd-b6bb-dd9b2187b6b9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.409226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268dbd54-8300-4bfd-b6bb-dd9b2187b6b9 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.414735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 938/1880] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:56:38.433485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.435355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.437632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.466971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:38.469604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.614367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 939/1881] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:56:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:38.634802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:38.636260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.655663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a1dc-25e5-4d50-8a2a-ea515a795b07 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:38.661051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '905a113198b04007804e56bc71cc77e5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.662709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '905a113198b04007804e56bc71cc77e5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.662918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:38.663648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:38.663881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '905a113198b04007804e56bc71cc77e5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.663985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:38.664186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:38.666811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:38.671554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '905a113198b04007804e56bc71cc77e5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.682766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:38.685846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:38.691165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '905a113198b04007804e56bc71cc77e5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:38.705815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 940/1882] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:38.879426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 943/1883] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:38 2022] DELETE /identity/v3/users/905a113198b04007804e56bc71cc77e5 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:39.687543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:39.690043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:39.723316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff164b-0493-48d5-a7a9-1869ff5cd023 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:39.796412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:39.797094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:39.797374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:39.797669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] PATH_INFO: `/v3/projects/7ae4dacc52c54c35b808e77adfc7b588` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:39.798985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae4dacc52c54c35b808e77adfc7b588)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:39.801209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:39.880783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:39.882375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:39.895876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69bd74-4cec-4325-86fc-9d8b79cd1398 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:39.901293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:39.901951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:39.902252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:39.902527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] PATH_INFO: `/v3/users/e425449746c74f84980c53b32abfe62d` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:39.903724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e425449746c74f84980c53b32abfe62d)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:39.905702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.008391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae4dacc52c54c35b808e77adfc7b588', 'request_id': 'req-fe6799dc-08b3-43b3-88c1-042afe79ed0c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.019008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae4dacc52c54c35b808e77adfc7b588', 'request_id': 'req-fe6799dc-08b3-43b3-88c1-042afe79ed0c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.027668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae4dacc52c54c35b808e77adfc7b588', 'request_id': 'req-fe6799dc-08b3-43b3-88c1-042afe79ed0c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.189547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] The token cache is being invalidate because project 7ae4dacc52c54c35b808e77adfc7b588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:40.189830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.190580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fe6799dc-08b3-43b3-88c1-042afe79ed0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.192438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 941/1884] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:39 2022] DELETE /identity/v3/projects/7ae4dacc52c54c35b808e77adfc7b588 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:40.198458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e7ea-93ff-4c6e-b367-c660594a2670 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.198740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e7ea-93ff-4c6e-b367-c660594a2670 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.199619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49e7ea-93ff-4c6e-b367-c660594a2670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.221817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-2b49e7ea-93ff-4c6e-b367-c660594a2670 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:40.223314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2b49e7ea-93ff-4c6e-b367-c660594a2670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:40.240149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e425449746c74f84980c53b32abfe62d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.241338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e425449746c74f84980c53b32abfe62d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.242141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e425449746c74f84980c53b32abfe62d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.256173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e425449746c74f84980c53b32abfe62d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.268252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-821b8fec-72a7-4b25-8710-5f7ec5dffe1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e425449746c74f84980c53b32abfe62d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:40.287914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 942/1885] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:40.295795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.296079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.303181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.316192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:40.317467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:40.326376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 943/1886] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:40.330492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.340826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42bbed-8095-4e6d-92fc-5f42f670800d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.345425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.354868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.363506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 944/1887] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:40.371634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.386495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734cfaa-949b-4ea1-b35f-cd97ec11049f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.392934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18510263-842e-48fe-8369-68789513383e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.405766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18510263-842e-48fe-8369-68789513383e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.405766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18510263-842e-48fe-8369-68789513383e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.405766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18510263-842e-48fe-8369-68789513383e admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.405766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18510263-842e-48fe-8369-68789513383e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.405766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18510263-842e-48fe-8369-68789513383e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.415281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 944/1888] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:39 2022] DELETE /identity/v3/users/e425449746c74f84980c53b32abfe62d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:40.421757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.422480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.422956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.467643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:40.469772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:40.563774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 945/1889] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:40.582273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.585597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:40.590194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 945/1890] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:40 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:40.593676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18510263-842e-48fe-8369-68789513383e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.689205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a7aa8-af80-4e21-ac80-cae5d72e9522 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.698049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18510263-842e-48fe-8369-68789513383e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.703051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.703758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.704110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.704455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.705359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.708124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.795736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.796458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.796908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.797256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.814722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.816664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.819460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 946/1891] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:40 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:40.824122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.850489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611ba3-4148-4742-9e75-9b439e862951 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.852104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 946/1892] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:40.867168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.868817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:40.869328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.870176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.870765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.871314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.872149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.874662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.905184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 947/1893] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:40.909418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.923193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43700a37-55e0-4096-9a1a-3583740a042b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.929833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.930601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.931036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.941726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.941726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:40.941726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:40.955378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 948/1894] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:40.958030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:40.970953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc48ad-b957-4530-8bc6-85592c14bf23 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.972801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19249e5d-7259-4d2a-844b-fcbe9999565a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:40.980254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:40.985716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.985971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:40.986141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.986141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.986141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] PATH_INFO: `/v3/projects/fa7c2a7004d54251ba6a232b86eb75ed/users/c9cb6473c3dc47c6866d089ae647ce12/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.986597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:40.986597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:40.986597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:40.991022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:41.011144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7c2a7004d54251ba6a232b86eb75ed, user_id=c9cb6473c3dc47c6866d089ae647ce12, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:41.015600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:41.108775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:41.110509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10399b38-7431-49e6-8f36-0ec51f4e98a0 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:41.127156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 947/1895] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:41.180151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 949/1896] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:40 2022] PUT /identity/v3/projects/fa7c2a7004d54251ba6a232b86eb75ed/users/c9cb6473c3dc47c6866d089ae647ce12/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:41.187587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:41.187914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:41.188088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:41.230387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] MFA Rules not processed for user `c9cb6473c3dc47c6866d089ae647ce12`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:41.231666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:41.320122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 948/1897] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:41.325839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:41.394709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:41.418868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fe6ed-2523-4cd6-b0a0-efae3cb5b94c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:41.424367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:41.425032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:41.425307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:41.425577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:41.426236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:41.428996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:41.498365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:41.499797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:41.514607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04463d3-15c8-448b-99f9-2070169959d5 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:41.519453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:41.520108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:41.520383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:41.520654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] PATH_INFO: `/v3/users/7409fa97903f4e58a4bf6204cc4f9632` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:41.521962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7409fa97903f4e58a4bf6204cc4f9632)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:41.523911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:41.667556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 950/1898] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:41 2022] POST /identity/v3/projects => generated 379 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:41.670791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:41.760424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92e454-2281-41a8-9141-374707d22419 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:41.766777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:41.768504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:41.768930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:41.769363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:41.770183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:41.772667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:41.963489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7409fa97903f4e58a4bf6204cc4f9632'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:41.964182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7409fa97903f4e58a4bf6204cc4f9632'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:41.965172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7409fa97903f4e58a4bf6204cc4f9632'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:41.972976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7409fa97903f4e58a4bf6204cc4f9632'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:41.986767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7409fa97903f4e58a4bf6204cc4f9632'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.016822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 951/1899] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:41 2022] POST /identity/v3/users => generated 296 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:42.017815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.020076 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.039480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae7f2a-ff91-4f85-abc2-950e4aba219f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.039480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.039480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.039480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.040120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] PATH_INFO: `/v3/projects/1549df946efb4878ad0fc77ebb12adf4` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.041105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1549df946efb4878ad0fc77ebb12adf4)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.043023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.179939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 949/1900] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:41 2022] DELETE /identity/v3/users/7409fa97903f4e58a4bf6204cc4f9632 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:42.181855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.186383 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.213733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1549df946efb4878ad0fc77ebb12adf4', 'request_id': 'req-0c8a1f8c-3177-4e35-ad01-07f95e7be707'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.225070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1549df946efb4878ad0fc77ebb12adf4', 'request_id': 'req-0c8a1f8c-3177-4e35-ad01-07f95e7be707'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.232432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1549df946efb4878ad0fc77ebb12adf4', 'request_id': 'req-0c8a1f8c-3177-4e35-ad01-07f95e7be707'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.288356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258254a-c05c-4abc-96d3-88e5199d1ef3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.377147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.378641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] The token cache is being invalidate because project 1549df946efb4878ad0fc77ebb12adf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:42.379585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.380013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.381198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.381311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.382340 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.383035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0c8a1f8c-3177-4e35-ad01-07f95e7be707 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.387922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.388602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 952/1901] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:42 2022] DELETE /identity/v3/projects/1549df946efb4878ad0fc77ebb12adf4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:42.409077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.409077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.409077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.409385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 950/1902] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:42.409385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.412643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.427640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cf626-8d1b-4d2c-a8c7-57a1b779d7f6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.428927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:42.430984 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.435873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.436939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.437423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.438014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] PATH_INFO: `/v3/users/ca08ebd3d00544bc8ec67ac153e1338b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.439453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 953/1903] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:42.453278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.453652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca08ebd3d00544bc8ec67ac153e1338b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.453761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.453840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.488294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95f556-5ff4-4549-94c1-642dc78b17e6 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.493346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.494035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.494299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.494572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] PATH_INFO: `/v3/projects/0a455c2f90414008a6335693f1b0b0a9/users/dfada20100a846519aa809f6c2891e67/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.510913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a455c2f90414008a6335693f1b0b0a9, user_id=dfada20100a846519aa809f6c2891e67, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.513725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.657535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 954/1904] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:42 2022] PUT /identity/v3/projects/0a455c2f90414008a6335693f1b0b0a9/users/dfada20100a846519aa809f6c2891e67/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:42.658648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.661025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.733120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca08ebd3d00544bc8ec67ac153e1338b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.734303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca08ebd3d00544bc8ec67ac153e1338b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.735582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca08ebd3d00544bc8ec67ac153e1338b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.746950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65964201-8a2a-4b23-ab13-c7fcc649c710 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.748796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca08ebd3d00544bc8ec67ac153e1338b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.752465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.753222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.753559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.753832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.757215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.764627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca08ebd3d00544bc8ec67ac153e1338b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:42.836280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.837783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.848443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 955/1905] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:42.849986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:42.852005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:42.868734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1104801-1c4c-40e2-9626-1400ba8f310c service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:42.876160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:42.881391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:42.887128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 951/1906] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:42 2022] DELETE /identity/v3/users/ca08ebd3d00544bc8ec67ac153e1338b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:42.895782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:42.897614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:42.897766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:42.898754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:42.900847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56628307-a35d-4278-8472-2d0a25b4de2d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:42.916761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 956/1907] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:42.928293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:43.048589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee7122-da80-408a-b52e-89da3cdebb1a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:43.055469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:43.056422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:43.056927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:43.057634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] PATH_INFO: `/v3/projects/0a455c2f90414008a6335693f1b0b0a9/users/dfada20100a846519aa809f6c2891e67/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:43.059280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a455c2f90414008a6335693f1b0b0a9, user_id=dfada20100a846519aa809f6c2891e67, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:43.062149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:43.082333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 952/1908] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:42 2022] PUT /identity/v3/projects/0a455c2f90414008a6335693f1b0b0a9/users/dfada20100a846519aa809f6c2891e67/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:43.094467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:43.095172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:43.095564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:43.134006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] MFA Rules not processed for user `dfada20100a846519aa809f6c2891e67`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:43.135413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:43.242910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 957/1909] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:43.257167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:43.258827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:43.485033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582b75-7458-4e8f-a36e-4c98d022fe4a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:43.493781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:43.494567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:43.494926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:43.495269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:43.519217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:43.522412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:43.539116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 953/1910] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:43.834831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:43.839730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:43.841348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:43.919280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dbe25-2a22-4194-87ec-02037e1c0385 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:43.923877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:43.924521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:43.924813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:43.925085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] PATH_INFO: `/v3/projects/60ae41b8e6b84e5da94ba56045338924` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:43.926235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ae41b8e6b84e5da94ba56045338924)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:43.929296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:43.942646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:43.944830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:43.967365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fc1c31-bf50-4590-8b9c-68ce8d41c4ca service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:43.973858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:43.975155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:43.975857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:43.976205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] PATH_INFO: `/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:43.977465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8bf9e64f61e4fafacf8a5b12b8522c4)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:43.979612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:44.128951 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ae41b8e6b84e5da94ba56045338924', 'request_id': 'req-59dd2158-38e4-4c08-b785-0b943a760c88'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.138160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8bf9e64f61e4fafacf8a5b12b8522c4', 'request_id': 'req-56344689-ab60-4fad-b723-0827f9536ce9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.147596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ae41b8e6b84e5da94ba56045338924', 'request_id': 'req-59dd2158-38e4-4c08-b785-0b943a760c88'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.157114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ae41b8e6b84e5da94ba56045338924', 'request_id': 'req-59dd2158-38e4-4c08-b785-0b943a760c88'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.265447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8bf9e64f61e4fafacf8a5b12b8522c4', 'request_id': 'req-56344689-ab60-4fad-b723-0827f9536ce9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.273434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8bf9e64f61e4fafacf8a5b12b8522c4', 'request_id': 'req-56344689-ab60-4fad-b723-0827f9536ce9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.285902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] The token cache is being invalidate because project b8bf9e64f61e4fafacf8a5b12b8522c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:44.286299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.288022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.289950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 954/1911] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:43 2022] DELETE /identity/v3/projects/b8bf9e64f61e4fafacf8a5b12b8522c4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:44.290835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:44.292257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.364113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56344689-ab60-4fad-b723-0827f9536ce9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:44.373041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:44.376401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.377032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.377456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.379684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.393075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] The token cache is being invalidate because project 60ae41b8e6b84e5da94ba56045338924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:44.393373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.394058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-59dd2158-38e4-4c08-b785-0b943a760c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:44.396815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 958/1912] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:43 2022] DELETE /identity/v3/projects/60ae41b8e6b84e5da94ba56045338924 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:44.400081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92bc25-853e-409f-9978-fa9b5460100a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.400081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92bc25-853e-409f-9978-fa9b5460100a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.400081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92bc25-853e-409f-9978-fa9b5460100a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.423937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3a92bc25-853e-409f-9978-fa9b5460100a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:44.425775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3a92bc25-853e-409f-9978-fa9b5460100a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.467904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:44.469600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:44.483730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 955/1913] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:44.484738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:44.486778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.568870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 959/1914] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:44.576570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.576898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.577178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.596764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:44.598303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:44.601382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46423f1-76d4-47be-8c93-b757eb0ef63e service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:44.606450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:44.607093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.608458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 960/1915] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:44.608570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.608570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] PATH_INFO: `/v3/users/8e847408fea3402aaa5fb245edc2c2ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.608947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e847408fea3402aaa5fb245edc2c2ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:44.611229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:44.612199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:44.623552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc5314-a9a2-4ad4-a887-82a1af94a170 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:44.629055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:44.629676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.629948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.630331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.631821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:44.634406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:44.634406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:44.647048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 961/1916] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:44.651703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:44.667534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b9e7a-78c6-47c9-85bd-beb8f1933bce admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:44.672511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:44.677306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:44.677306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:44.677306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:44.677306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:44.677306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:44.969183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 962/1917] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/projects => generated 365 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:44.973568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.055115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3013c5-aa94-4a25-b77f-55dde948591c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.060402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.061043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.061321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.061590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.062234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.067862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.143480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e847408fea3402aaa5fb245edc2c2ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:45.144241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e847408fea3402aaa5fb245edc2c2ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:45.144894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e847408fea3402aaa5fb245edc2c2ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:45.153941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e847408fea3402aaa5fb245edc2c2ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:45.172009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15a25aaf-744f-4dea-9fc0-718ca0db1fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e847408fea3402aaa5fb245edc2c2ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:45.200759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 963/1918] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:44 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:45.204645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.206431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:45.220847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57749ae-8ba9-4a26-bdea-48bc4bcd5134 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.230996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.231674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.254741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.254741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.254741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.254741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.254741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 964/1919] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:45.263218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.274784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b554e74-4992-457c-b828-ce14c9b843f7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.281488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.282350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.282693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.283032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.283756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.285631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.308095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 965/1920] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:45.309198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.319652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd742bdd-49bc-4f9b-8a60-39ea0f1e4e0a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.323174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 956/1921] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:44 2022] DELETE /identity/v3/users/8e847408fea3402aaa5fb245edc2c2ee => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:45.392350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.393499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.394029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.394574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] PATH_INFO: `/v3/projects/3b2004853adb4a0e9eb8e0a7dea542a4/users/e8baed79b5a54626953e4c21f751e26c/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.412377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b2004853adb4a0e9eb8e0a7dea542a4, user_id=e8baed79b5a54626953e4c21f751e26c, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.415215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:45.622735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 966/1922] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:45 2022] PUT /identity/v3/projects/3b2004853adb4a0e9eb8e0a7dea542a4/users/e8baed79b5a54626953e4c21f751e26c/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:45.634582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.635490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.636039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.691809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] MFA Rules not processed for user `e8baed79b5a54626953e4c21f751e26c`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:45.694780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:45.794773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 957/1923] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:45.803909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:45.921187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652d07b-76e5-4bf6-82f0-b64ce581873d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:45.926538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:45.927769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:45.928053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:45.928325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:45.929032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:45.931007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.019189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.022202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:46.039720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a01c1-b7d7-4b7d-bb8f-d2974f4f38eb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.057245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 967/1924] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:45 2022] POST /identity/v3/projects => generated 365 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:46.061032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.064649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.067240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.068176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.072770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] PATH_INFO: `/v3/projects/450fb447e07b450db50842a0d55a6bb5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.079971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=450fb447e07b450db50842a0d55a6bb5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.081998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.194881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da17a2b-8ed6-4fbb-b4c2-42bccc171e69 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.203647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.205910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.206451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.207433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.208256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.213999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.307168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450fb447e07b450db50842a0d55a6bb5', 'request_id': 'req-15dad89f-6753-4d00-91c9-aff6e27ba940'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:46.422096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 968/1925] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:46 2022] POST /identity/v3/users => generated 289 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:46.424060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.448788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97946214-2f08-46b9-8bbb-d97b8ab24738 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.475972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450fb447e07b450db50842a0d55a6bb5', 'request_id': 'req-15dad89f-6753-4d00-91c9-aff6e27ba940'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:46.486521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450fb447e07b450db50842a0d55a6bb5', 'request_id': 'req-15dad89f-6753-4d00-91c9-aff6e27ba940'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:46.501251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] The token cache is being invalidate because project 450fb447e07b450db50842a0d55a6bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:46.502152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:46.506004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15dad89f-6753-4d00-91c9-aff6e27ba940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:46.509101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 958/1926] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:46 2022] DELETE /identity/v3/projects/450fb447e07b450db50842a0d55a6bb5 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:46.514586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fc771-f309-43b7-81b8-532e76d91d34 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.514816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fc771-f309-43b7-81b8-532e76d91d34 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.515147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fc771-f309-43b7-81b8-532e76d91d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.558802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-846fc771-f309-43b7-81b8-532e76d91d34 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:46.560877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-846fc771-f309-43b7-81b8-532e76d91d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:46.594953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.594953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.594953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.594953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.595282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.598806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.622553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 969/1927] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:46.626589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.635098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:46.658871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1cb93-2ff4-444c-9e0c-9118a2362e2d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.666920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.667690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.668049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.668251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] PATH_INFO: `/v3/projects/92df9b6955d04bcca09a3e83e2628127/users/3f2bafa6897440f5a55436fd47bb9c19/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.683610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 959/1928] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:46.685956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.686550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.686892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.688552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92df9b6955d04bcca09a3e83e2628127, user_id=3f2bafa6897440f5a55436fd47bb9c19, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.691524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.719938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:46.721282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:46.738492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 960/1929] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:46.739884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.753293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01cd204-b41b-48f9-be99-38b1c82870af None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.761944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.771834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.774861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.774861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.775881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:46.775881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.778321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.799963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 961/1930] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:56:46.805165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.824553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f5bd-9af8-4de0-844b-eafa2f81aa43 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.829954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.831053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.831053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.831257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.831745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.834396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.841439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 970/1931] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:46 2022] PUT /identity/v3/projects/92df9b6955d04bcca09a3e83e2628127/users/3f2bafa6897440f5a55436fd47bb9c19/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:46.847638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.942040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6026-6d43-46ad-be3f-3762401ea6b0 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:46.948534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:46.949228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:46.949738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:46.949851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:46.950449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:46.952129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:46.966938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 971/1932] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:46.967985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:46.975977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.007218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6728eb3-c23d-44ee-94b6-91211b4130f5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.014680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.014680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.014680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.014983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] PATH_INFO: `/v3/users/fb5cde0db18c4cffa00fe6eef9cf7b73` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.015866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5cde0db18c4cffa00fe6eef9cf7b73)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.018048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:47.028520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:47.039576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 962/1933] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:46 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:56:47.046020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.153742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0a455-58ff-432f-bd48-097e2b2242dd admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.164756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.165829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.166236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.166685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] PATH_INFO: `/v3/projects/92df9b6955d04bcca09a3e83e2628127/users/3f2bafa6897440f5a55436fd47bb9c19/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.170684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92df9b6955d04bcca09a3e83e2628127, user_id=3f2bafa6897440f5a55436fd47bb9c19, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.175281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:47.190839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 963/1934] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:47 2022] PUT /identity/v3/projects/92df9b6955d04bcca09a3e83e2628127/users/3f2bafa6897440f5a55436fd47bb9c19/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:47.191672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.260571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef360d6-d005-44cc-8169-c013b483fc01 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.265396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.266020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.266302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.266576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.267210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.269203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d045cd4-e4c6-49d4-83de-c70be5a69b28 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:47.344670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5cde0db18c4cffa00fe6eef9cf7b73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:47.345509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5cde0db18c4cffa00fe6eef9cf7b73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:47.346131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5cde0db18c4cffa00fe6eef9cf7b73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:47.454903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 964/1935] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:47 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:47.459238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6939-0b3f-46cc-bfe4-f1bce5a0197c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.459564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6939-0b3f-46cc-bfe4-f1bce5a0197c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.460071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc6939-0b3f-46cc-bfe4-f1bce5a0197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.480604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5cde0db18c4cffa00fe6eef9cf7b73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:47.491796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5cde0db18c4cffa00fe6eef9cf7b73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:47.503165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-86fc6939-0b3f-46cc-bfe4-f1bce5a0197c None None] MFA Rules not processed for user `3f2bafa6897440f5a55436fd47bb9c19`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:47.504908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-86fc6939-0b3f-46cc-bfe4-f1bce5a0197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.547831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 972/1936] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:46 2022] DELETE /identity/v3/users/fb5cde0db18c4cffa00fe6eef9cf7b73 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:47.547831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.547831 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.726875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 965/1937] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:47.728733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.730935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.731238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.781869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:47.782598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4f7a0-ad7a-49b4-ae4a-d305457422b2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.785281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.804752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.804752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.804752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.804752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.805262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.805262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:47.814016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 966/1938] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:47.820564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 973/1939] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:47.822501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.824451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.824854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.826817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:47.949007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac260db-9d3f-4d8e-99ce-4bc7d8c3d566 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.949007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.949007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.949007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.950069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.950069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.950360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faed84b-841b-48e8-bf93-d3de53d71791 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.950509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:47.950653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.950653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.950653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.950653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.951154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 967/1940] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:47.951154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:47.957267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148fce29-af86-4a03-a8a0-64c1f69b2a2c service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:47.974028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:47.975470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:47.976195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:47.976823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:47.978837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:47.983252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:48.004789 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 968/1941] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:48.009610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:48.023875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9665c7-b4e7-4b52-9fe4-34b219c42633 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:48.028600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:48.029298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:48.029578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:48.029851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] PATH_INFO: `/v3/projects/719739539ba94f25af32e0f863a5a5dc/users/2d787e88278341b69b9f1ca9f052fb56/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:48.037631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:48.039908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cdd4d9-b140-47e1-bf71-5641f09d036a service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:48.053799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 974/1942] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:48.063840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] RBAC: Authorizing `identity:create_grant(project_id=719739539ba94f25af32e0f863a5a5dc, user_id=2d787e88278341b69b9f1ca9f052fb56, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:48.067232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:48.204445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 969/1943] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:48 2022] PUT /identity/v3/projects/719739539ba94f25af32e0f863a5a5dc/users/2d787e88278341b69b9f1ca9f052fb56/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:56:48.206408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:48.206625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:48.206895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:48.248687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:48.250227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:48.331233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:48.366239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 975/1944] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:48.418282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:48.419734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:48.422450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:48.530134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd12e11-3897-4f1d-b832-bf0720fd275a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:48.534709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:48.536094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:48.537014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:48.537553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:48.542604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc4fcef-3a64-40f1-bab6-f7814ec9347c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:48.548258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:48.549063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:48.549347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:48.549625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:48.549744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:48.551190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:48.551629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:48.571095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 970/1945] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:48.640259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:48.642519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:48.666615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 976/1946] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:48.875482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:48.878036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:48.905985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45e101-13bb-43d2-8796-e2a03202fc97 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:48.921096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:48.921787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:48.922443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:48.922704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] PATH_INFO: `/v3/projects/8b425c683fcb4ed98ac18461fa603980` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:48.924787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b425c683fcb4ed98ac18461fa603980)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:48.927864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:49.105770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b425c683fcb4ed98ac18461fa603980', 'request_id': 'req-8465e01e-957b-4ccd-81de-91495d978ef3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.194293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b425c683fcb4ed98ac18461fa603980', 'request_id': 'req-8465e01e-957b-4ccd-81de-91495d978ef3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.207268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b425c683fcb4ed98ac18461fa603980', 'request_id': 'req-8465e01e-957b-4ccd-81de-91495d978ef3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.230207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] The token cache is being invalidate because project 8b425c683fcb4ed98ac18461fa603980 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:49.230850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.232105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.235076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 971/1947] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:48 2022] DELETE /identity/v3/projects/8b425c683fcb4ed98ac18461fa603980 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:49.239001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:49.254946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d4c42-cca3-4379-a905-d340f5d6dae8 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:49.339833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:49.340827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:49.341122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:49.341800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] PATH_INFO: `/v3/users/2ee32cf8f7dd46049dae30231785fd06` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:49.344218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee32cf8f7dd46049dae30231785fd06)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:49.346313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:49.661303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee32cf8f7dd46049dae30231785fd06'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.662546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee32cf8f7dd46049dae30231785fd06'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.663811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee32cf8f7dd46049dae30231785fd06'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.806484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee32cf8f7dd46049dae30231785fd06'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.823399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c5be26b8-48cf-4ce9-b3fe-c644ca579be9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee32cf8f7dd46049dae30231785fd06'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:49.853836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 977/1948] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:49 2022] DELETE /identity/v3/users/2ee32cf8f7dd46049dae30231785fd06 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:50.923750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:50.924228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:50.939225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e01e-957b-4ccd-81de-91495d978ef3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:51.032621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:51.033592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.034109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.034573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] PATH_INFO: `/v3/projects/3063079432534ee2a09105c912258056` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.035964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3063079432534ee2a09105c912258056)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:51.038808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:51.187680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3063079432534ee2a09105c912258056', 'request_id': 'req-019213cb-c385-4863-afb8-382e5a911bad'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.232638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.234044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.234542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.274753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] MFA Rules not processed for user `2d787e88278341b69b9f1ca9f052fb56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:51.276644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.341923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3063079432534ee2a09105c912258056', 'request_id': 'req-019213cb-c385-4863-afb8-382e5a911bad'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.351989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3063079432534ee2a09105c912258056', 'request_id': 'req-019213cb-c385-4863-afb8-382e5a911bad'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.381676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] The token cache is being invalidate because project 3063079432534ee2a09105c912258056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:51.383534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.384802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.391512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 972/1949] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:50 2022] DELETE /identity/v3/projects/3063079432534ee2a09105c912258056 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:51.393269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:51.394866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.415667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 978/1950] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:51.447855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:51.449876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.491780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019213cb-c385-4863-afb8-382e5a911bad admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:51.504133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:51.505440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.511337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.511787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] PATH_INFO: `/v3/users/47fa80ca00d24f8c8f717ba4bb1bdc75` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.513439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fa80ca00d24f8c8f717ba4bb1bdc75)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:51.515530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:51.547781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82c6f4-ba55-419c-b642-914f28851159 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:51.552641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:51.553615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:51.553974 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:51.554340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:51.556406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:51.570531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:51.572126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:51.599321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 979/1951] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:56:51.790234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:51.921484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fa80ca00d24f8c8f717ba4bb1bdc75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.922497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fa80ca00d24f8c8f717ba4bb1bdc75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.923125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fa80ca00d24f8c8f717ba4bb1bdc75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.931923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fa80ca00d24f8c8f717ba4bb1bdc75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:51.946869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-88bde064-d49b-4a40-87dc-6bace181523c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fa80ca00d24f8c8f717ba4bb1bdc75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:52.118537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 973/1952] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:56:51 2022] DELETE /identity/v3/users/47fa80ca00d24f8c8f717ba4bb1bdc75 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:52.785801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:52.801824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d55454-5117-419a-8da2-3002a19dd185 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:52.896434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:52.897150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:52.897569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:52.897885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] PATH_INFO: `/v3/projects/0d6038c3f6a6469596d0585ffa34fea7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:52.899167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6038c3f6a6469596d0585ffa34fea7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:52.901277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:53.086307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6038c3f6a6469596d0585ffa34fea7', 'request_id': 'req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:53.093062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6038c3f6a6469596d0585ffa34fea7', 'request_id': 'req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:53.099772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6038c3f6a6469596d0585ffa34fea7', 'request_id': 'req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:53.774157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:54.358632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] The token cache is being invalidate because project 0d6038c3f6a6469596d0585ffa34fea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:56:54.364739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:54.364739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f5446f51-b1e2-4e9b-807c-bc3e2a1d847f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:56:54.364739 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 980/1953] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:56:52 2022] DELETE /identity/v3/projects/0d6038c3f6a6469596d0585ffa34fea7 => generated 0 bytes in 1576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:54.368600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390b57-86e1-486c-8019-9e624298f065 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:54.368919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390b57-86e1-486c-8019-9e624298f065 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:54.369196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11390b57-86e1-486c-8019-9e624298f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:54.390325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-11390b57-86e1-486c-8019-9e624298f065 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:54.391556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-11390b57-86e1-486c-8019-9e624298f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:54.453441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 974/1954] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:54.464662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:54.465298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:54.465645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:54.487342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:54.488469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:54.497212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 981/1955] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:54.501751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390b57-86e1-486c-8019-9e624298f065 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:54.511778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11390b57-86e1-486c-8019-9e624298f065 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:54.516504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:54.517156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:54.517434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:54.517705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:54.518355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:56:54.518658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:54.520264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:54.532087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 975/1956] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:56:54.537730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:54.548259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8717c-f2f5-4754-a4af-a5ddf7c51ee7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:54.553580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:54.554178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:54.554455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:54.554722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:54.555395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:54.557506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:54.732986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 982/1957] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:54 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:54.742190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:54.749270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6163f8-2fcc-4731-b0d0-b99e6efae1b0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:54.809035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:54.809745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:54.809979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:54.810250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:54.810889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:54.812903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8534268c-129a-4b68-93a6-2cf4fdcf1056 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:54.995592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 976/1958] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:54 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:55.001823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:55.034122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee18dffd-1dff-48dd-948b-fe0b21e6871e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:55.034122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:55.034122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.034122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.034818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.034818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:55.034818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:55.051749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0684-a804-4449-a911-186568dd5e9b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.052769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0684-a804-4449-a911-186568dd5e9b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.053190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0684-a804-4449-a911-186568dd5e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.057309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 983/1959] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:55.062443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:55.075447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d25aa-ab7c-4e0e-aa56-8bc1673d73b5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:55.081449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:55.082542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.082822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.083667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.084592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e57f0684-a804-4449-a911-186568dd5e9b None None] MFA Rules not processed for user `2d787e88278341b69b9f1ca9f052fb56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:55.085132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:55.086693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e57f0684-a804-4449-a911-186568dd5e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:55.086821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:55.109678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 984/1960] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:56:55.114017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:55.135117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2e7b8-1527-4af3-8e95-d0f5646dc615 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:55.139987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:55.140852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.141210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.141562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] PATH_INFO: `/v3/projects/49da8ce5544544a79b2682c5c898132c/users/92784971413b4b07b629140f3630fba7/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.156966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 977/1961] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:55.169181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49da8ce5544544a79b2682c5c898132c, user_id=92784971413b4b07b629140f3630fba7, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:55.173544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:55.388628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 985/1962] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:55 2022] PUT /identity/v3/projects/49da8ce5544544a79b2682c5c898132c/users/92784971413b4b07b629140f3630fba7/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:55.399313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.399764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.400109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.449444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] MFA Rules not processed for user `92784971413b4b07b629140f3630fba7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:55.450852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:55.539294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 978/1963] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:55.543707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:55.622770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5907-e354-4f5a-9d2a-3a89f6819a16 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:55.629013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:55.634736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.635415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.635933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.637252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:55.641061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:55.818114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 986/1964] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:55 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:55.823714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:55.836265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8bdc-0e76-4b7b-a355-a0883feaebd4 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:55.898420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:55.899045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:55.899435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:55.899713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:55.900348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:55.902451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.086324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 979/1965] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:55 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:56.090392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:56.103518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02e626-4edd-4c82-a8f3-3b86ec832c93 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:56.110171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:56.110798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.111079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.111352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.112040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:56.113840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.132300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 987/1966] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:56.136697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:56.150890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48779e0-3eb7-4fce-9d46-9a98a45048f7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:56.156981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:56.157985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.158272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.158551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.159218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:56.160850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5875-1138-4107-ad7b-09620fdda134 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.176448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 980/1967] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:56.181461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:56.197306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc12f93-3966-4b24-a28e-9cb165a60107 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:56.206838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:56.206838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.206838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.206838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] PATH_INFO: `/v3/projects/d9a5c3a2473a45bc8ae85b1d5510bc1e/users/71ae68630b2945328382e1ce46c1a6a6/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.229734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a5c3a2473a45bc8ae85b1d5510bc1e, user_id=71ae68630b2945328382e1ce46c1a6a6, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:56.232692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.348194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 988/1968] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:56 2022] PUT /identity/v3/projects/d9a5c3a2473a45bc8ae85b1d5510bc1e/users/71ae68630b2945328382e1ce46c1a6a6/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:56.358848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.359134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.359409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.392534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] MFA Rules not processed for user `71ae68630b2945328382e1ce46c1a6a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:56.393844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:56.465074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 981/1969] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:56:56.474511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:56.548081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4ebbb9-61ee-4105-b3c0-bf5dfe0128db admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:56.553645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:56.554380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.554789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.555180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.555922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:56.557966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.736685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 989/1970] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:56:56 2022] POST /identity/v3/projects => generated 385 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:56.741169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:56.758420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b47567-34e4-425e-b3a8-1b7c4212c929 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:56.824648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:56.825325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:56.826203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:56.826485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:56.827136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:56.829115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:56.994355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 982/1971] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:56:56 2022] POST /identity/v3/users => generated 299 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:56:56.998334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:57.009460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b93fc2-1732-4ea1-8f00-3b63c492672d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:57.014104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:57.014763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.015100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.015397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.015956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:57.017620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:57.028819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 990/1972] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:57.062986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:57.075270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078908c8-1894-4bc4-bf87-91701b267073 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:57.080414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:57.081133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.081770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.082191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] PATH_INFO: `/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4/users/2fa0dab861cd41acaeb42d44e0ac3424/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.100670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7ae86b7ea409f8542d2dd6537f9b4, user_id=2fa0dab861cd41acaeb42d44e0ac3424, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:57.104603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:57.376884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 983/1973] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:57 2022] PUT /identity/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4/users/2fa0dab861cd41acaeb42d44e0ac3424/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:57.407161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:57.418775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b7045-07f3-4c2f-bc33-136ffb57692c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:57.497627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:57.498660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.498660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.498995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.499603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:57.501615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb3fb6-78e5-403b-af79-4277d7dd44c2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:57.514003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 991/1974] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:56:57.519771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:57.534481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d033f-9e51-496f-ab29-e9c3a23a5fe9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:57.539992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:57.541476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.546007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.546007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] PATH_INFO: `/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4/users/2fa0dab861cd41acaeb42d44e0ac3424/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.548120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef7ae86b7ea409f8542d2dd6537f9b4, user_id=2fa0dab861cd41acaeb42d44e0ac3424, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:57.553839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:57.569294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 984/1975] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:56:57 2022] PUT /identity/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4/users/2fa0dab861cd41acaeb42d44e0ac3424/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:56:57.581791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.582147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.582440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.592704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:57.613487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] MFA Rules not processed for user `2fa0dab861cd41acaeb42d44e0ac3424`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:56:57.615338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:57.704043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 992/1976] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:56:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:56:57.714040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:56:57.715418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:56:57.779639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e19cc2e-a006-49f4-b1bd-5649f0802758 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:56:57.783291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:56:57.783905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:56:57.784197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:56:57.784447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:56:57.853041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:56:57.854642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:56:57.867534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 985/1977] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:56:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:56:59.462542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:56:59.622338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:00.425119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:00.428055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:00.520614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:00.527043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:00.544908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e09384-b24f-4750-b905-3426d2b704be service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:00.554813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:00.557686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:00.565102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:00.566445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:00.578048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c631ff8-7b36-4560-a635-7f2533bc9f89 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:00.588451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:00.589160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:00.589446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:00.589719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] PATH_INFO: `/v3/users/c9cb6473c3dc47c6866d089ae647ce12` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:00.590892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cb6473c3dc47c6866d089ae647ce12)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:00.594147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:00.696412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:00.697907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177185b-f872-4063-a1c0-338e91a93cd8 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:00.708268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 986/1978] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:01.027112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cb6473c3dc47c6866d089ae647ce12'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:01.029036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cb6473c3dc47c6866d089ae647ce12'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:01.029647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cb6473c3dc47c6866d089ae647ce12'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:01.240480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cb6473c3dc47c6866d089ae647ce12'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:01.249026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cb6473c3dc47c6866d089ae647ce12'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:01.269217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 993/1979] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:00 2022] DELETE /identity/v3/users/c9cb6473c3dc47c6866d089ae647ce12 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:01.273733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:01.274026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:01.274312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:01.298188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:01.299464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:01.378869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 987/1980] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:01.388405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:01.389914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:01.460989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76011f-afc8-4b69-af1b-03b635285b4e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:01.464584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:01.465230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:01.465508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:01.465787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:01.476526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:01.478031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:01.488234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 994/1981] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:02.156612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:02.158132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:02.170505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d8484-e29a-4b81-b07a-15b4fdcca43d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:02.175099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:02.175880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:02.182344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:02.182645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] PATH_INFO: `/v3/projects/fa7c2a7004d54251ba6a232b86eb75ed` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:02.183929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7c2a7004d54251ba6a232b86eb75ed)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:02.186616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:02.427691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7c2a7004d54251ba6a232b86eb75ed', 'request_id': 'req-86926268-e82a-40b1-808e-14f16dd03ca1'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:02.570744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7c2a7004d54251ba6a232b86eb75ed', 'request_id': 'req-86926268-e82a-40b1-808e-14f16dd03ca1'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:02.579613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7c2a7004d54251ba6a232b86eb75ed', 'request_id': 'req-86926268-e82a-40b1-808e-14f16dd03ca1'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:02.592572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] The token cache is being invalidate because project fa7c2a7004d54251ba6a232b86eb75ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:02.592895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:02.594140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:02.595703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 988/1982] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:02 2022] DELETE /identity/v3/projects/fa7c2a7004d54251ba6a232b86eb75ed => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:02.600851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:02.611117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a12dc-5d3e-44f4-8270-ee66081dac69 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:02.681982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:02.683315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:02.683916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:02.684413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] PATH_INFO: `/v3/users/dfada20100a846519aa809f6c2891e67` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:02.686971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfada20100a846519aa809f6c2891e67)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:02.692070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:02.982579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:03.096194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfada20100a846519aa809f6c2891e67'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:03.097179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfada20100a846519aa809f6c2891e67'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:03.098134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfada20100a846519aa809f6c2891e67'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:03.244060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:03.325152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfada20100a846519aa809f6c2891e67'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:03.332751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfada20100a846519aa809f6c2891e67'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:03.351032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 995/1983] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:02 2022] DELETE /identity/v3/users/dfada20100a846519aa809f6c2891e67 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:03.492129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:03.494231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:03.565127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86926268-e82a-40b1-808e-14f16dd03ca1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:03.628911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:03.629796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:03.630009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:03.630280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:03.632682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:03.654572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:03.656130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:03.709819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:03.711438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:03.724885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 989/1984] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:03.734502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5b5c0-49d3-4288-ae9a-319a0840bfe6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:03.739840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:03.740612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:03.741005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:03.741438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] PATH_INFO: `/v3/users/e8baed79b5a54626953e4c21f751e26c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:03.743351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8baed79b5a54626953e4c21f751e26c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:03.746000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:04.166385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:04.167803 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.184183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d53d-3c30-4ad4-af26-4508ac7e25a9 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:04.189068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:04.189862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.190191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.190734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] PATH_INFO: `/v3/projects/0a455c2f90414008a6335693f1b0b0a9` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.193342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a455c2f90414008a6335693f1b0b0a9)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:04.195296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:04.333330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8baed79b5a54626953e4c21f751e26c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.334425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8baed79b5a54626953e4c21f751e26c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.335279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8baed79b5a54626953e4c21f751e26c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.413022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a455c2f90414008a6335693f1b0b0a9', 'request_id': 'req-a5ee5195-1f75-4a64-9ec6-08347fd96195'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.427563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8baed79b5a54626953e4c21f751e26c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.436512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7ee1a95d-2cd4-4e83-a47c-952738a191dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8baed79b5a54626953e4c21f751e26c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.456871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 996/1985] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:03 2022] DELETE /identity/v3/users/e8baed79b5a54626953e4c21f751e26c => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:04.462176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.462536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.462742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.492414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:04.494734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.568990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 997/1986] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:04.571877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a455c2f90414008a6335693f1b0b0a9', 'request_id': 'req-a5ee5195-1f75-4a64-9ec6-08347fd96195'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.580529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:04.580635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a455c2f90414008a6335693f1b0b0a9', 'request_id': 'req-a5ee5195-1f75-4a64-9ec6-08347fd96195'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.581282 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.592542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] The token cache is being invalidate because project 0a455c2f90414008a6335693f1b0b0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:04.592870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.593552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a5ee5195-1f75-4a64-9ec6-08347fd96195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:04.597924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 990/1987] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:04 2022] DELETE /identity/v3/projects/0a455c2f90414008a6335693f1b0b0a9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:04.603784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdbed-68e2-4e8c-8742-06a9aaa62f5f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.604074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdbed-68e2-4e8c-8742-06a9aaa62f5f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.604523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcdbed-68e2-4e8c-8742-06a9aaa62f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.627009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d9bcdbed-68e2-4e8c-8742-06a9aaa62f5f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:04.628437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d9bcdbed-68e2-4e8c-8742-06a9aaa62f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.640877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 991/1988] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:04.646560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.646854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.647107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.658468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667aa840-065a-44f9-a9bf-27a68acc1c4f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:04.664642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:04.665311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.665589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.665963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.667814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.670753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:04.672086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:04.682780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:04.684250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:04.689653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 992/1989] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:04.691283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:04.695810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 998/1990] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:04.704454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e38d-0e22-4d5c-9ff7-e6632a0e5a8e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:04.710915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:04.711547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.711824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.712185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.713022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:04.713329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:04.715011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:04.728943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 993/1991] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:04.733433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:04.750671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142af10-bfc4-4d83-879c-d2b792fced83 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:04.750671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:04.750671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.750671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.751143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.751143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:04.752544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:04.902003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 999/1992] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:04 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:04.903138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:04.915962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40de94c2-6a50-4f09-95c0-4c80bde41b31 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:04.988604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:04.990295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:04.990295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:04.990645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:04.991292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:04.993671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.178059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 994/1993] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:04 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:05.179259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:05.206889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad00e8-0548-4f06-bf56-b26d504e1a00 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:05.214689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:05.215801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.216538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.217442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.218432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:05.221098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.233706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1000/1994] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:05.237808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:05.256033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2986ebf1-9832-4ca6-ac7f-d3d1b6298c44 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:05.263319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:05.264226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.264562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.265927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.272796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:05.272796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.290121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 995/1995] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:05.295349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:05.316508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac7cde-da14-4243-80f2-01a7a58786cb admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:05.326778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:05.327889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.328349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.328855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] PATH_INFO: `/v3/projects/d51d97670b3943a783f5e81d68db2b54/users/1cf8ef2af56740a9a54b6a5fd1c2318a/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.355063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d51d97670b3943a783f5e81d68db2b54, user_id=1cf8ef2af56740a9a54b6a5fd1c2318a, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:05.360161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51451-ac0b-4e6c-8a3f-9c6e42adcac1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.493921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:05.496569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:05.525577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ae0a9-2931-4a56-87bc-1f3e1e8569df admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:05.541682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1001/1996] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:05 2022] PUT /identity/v3/projects/d51d97670b3943a783f5e81d68db2b54/users/1cf8ef2af56740a9a54b6a5fd1c2318a/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:05.555145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.555345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.555595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.619126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] MFA Rules not processed for user `1cf8ef2af56740a9a54b6a5fd1c2318a`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:05.620812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:05.627421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:05.630209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.630979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.631452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] PATH_INFO: `/v3/projects/3b2004853adb4a0e9eb8e0a7dea542a4` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.633375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b2004853adb4a0e9eb8e0a7dea542a4)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:05.636769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.723195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1002/1997] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:05.728084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:05.739640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a4cb-767e-4e1d-8012-22754dab5c12 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:05.745064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:05.746612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:05.747065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:05.747523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:05.748178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:05.751251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:05.886977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b2004853adb4a0e9eb8e0a7dea542a4', 'request_id': 'req-2d9dce01-807e-40a0-b762-ce8188830f3b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:05.919032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1003/1998] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:05 2022] POST /identity/v3/projects => generated 367 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:05.925683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.011832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936f6dc-fbc3-42cf-a477-3b807e219e4d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.019089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.019717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.020171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.020740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.021928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.024595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.056053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b2004853adb4a0e9eb8e0a7dea542a4', 'request_id': 'req-2d9dce01-807e-40a0-b762-ce8188830f3b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.062726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b2004853adb4a0e9eb8e0a7dea542a4', 'request_id': 'req-2d9dce01-807e-40a0-b762-ce8188830f3b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.076058 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] The token cache is being invalidate because project 3b2004853adb4a0e9eb8e0a7dea542a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:06.076374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.077150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.078651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 996/1999] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:05 2022] DELETE /identity/v3/projects/3b2004853adb4a0e9eb8e0a7dea542a4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:06.082818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.084306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:06.166932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dce01-807e-40a0-b762-ce8188830f3b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.172292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.173001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.173284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.173559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] PATH_INFO: `/v3/users/3f2bafa6897440f5a55436fd47bb9c19` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.174720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f2bafa6897440f5a55436fd47bb9c19)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.177345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.214279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1004/2000] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:05 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:06.219256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.222133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:06.238326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f696655-178f-47ad-9728-604dcbecd6f3 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.244315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.244987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.245265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.245537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.246185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.247845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.259575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1005/2001] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:06.274051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.284425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda13ab-dc03-4093-b133-18ce406e7cf1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.305119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:06.314953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.314953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.314953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.314953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] PATH_INFO: `/v3/projects/95cef30df4f541378bf358d944b3bfec/users/c2801c65f3e54b94a13156e1f3f9bf7b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.341475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cef30df4f541378bf358d944b3bfec, user_id=c2801c65f3e54b94a13156e1f3f9bf7b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.344499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.499014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f2bafa6897440f5a55436fd47bb9c19'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.501260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f2bafa6897440f5a55436fd47bb9c19'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.501753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1006/2002] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:06 2022] PUT /identity/v3/projects/95cef30df4f541378bf358d944b3bfec/users/c2801c65f3e54b94a13156e1f3f9bf7b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:06.503201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f2bafa6897440f5a55436fd47bb9c19'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.507036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.509295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:06.515742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f2bafa6897440f5a55436fd47bb9c19'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.533817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-530d3555-f352-443f-8277-bea1afcd947f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f2bafa6897440f5a55436fd47bb9c19'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:06.603973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eb655-89d8-47a2-8e58-a80617472a6a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.610238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.611565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.611565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.611975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.612881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.614869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.625760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1007/2003] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:06.630581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.641163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792507e-9f79-45ae-bac0-a43c7c1e9b42 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.646941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.647620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.647898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.648176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] PATH_INFO: `/v3/projects/95cef30df4f541378bf358d944b3bfec/users/c2801c65f3e54b94a13156e1f3f9bf7b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.651650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cef30df4f541378bf358d944b3bfec, user_id=c2801c65f3e54b94a13156e1f3f9bf7b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.653712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.655451 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 997/2004] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:06 2022] DELETE /identity/v3/users/3f2bafa6897440f5a55436fd47bb9c19 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:06.669750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1008/2005] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:06 2022] PUT /identity/v3/projects/95cef30df4f541378bf358d944b3bfec/users/c2801c65f3e54b94a13156e1f3f9bf7b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:06.680853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.681318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.681593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.720802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] MFA Rules not processed for user `c2801c65f3e54b94a13156e1f3f9bf7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:06.722104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:06.807646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 998/2006] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:06.819782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:06.821656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:06.907998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b929eca-985b-40e8-87f9-6cef83b6fb94 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:06.914587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:06.915229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:06.915505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:06.915776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:06.928113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:06.931386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c7b14-233b-42ef-9d52-d8ba20822db7 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:06.966524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1009/2007] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:07.413210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:07.414708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:07.492338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba07d-bdb0-44ee-8c8b-61a18e85afa9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:07.497246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:07.497905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:07.498184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:07.498465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] PATH_INFO: `/v3/projects/92df9b6955d04bcca09a3e83e2628127` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:07.499623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=92df9b6955d04bcca09a3e83e2628127)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:07.501786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:07.529072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:07.726134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92df9b6955d04bcca09a3e83e2628127', 'request_id': 'req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:07.856018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92df9b6955d04bcca09a3e83e2628127', 'request_id': 'req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:07.862179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92df9b6955d04bcca09a3e83e2628127', 'request_id': 'req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:07.874374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] The token cache is being invalidate because project 92df9b6955d04bcca09a3e83e2628127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:07.874677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:07.875331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-7434a9d7-b89e-49d9-921f-5bf1e95cd92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:07.876972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 999/2008] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:07 2022] DELETE /identity/v3/projects/92df9b6955d04bcca09a3e83e2628127 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:07.882273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:07.882769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:07.882952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:07.902217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:07.903410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:07.977794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1010/2009] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:07.986131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:07.986649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:07.986649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.010579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:08.015385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:08.021876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1000/2010] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:08.026380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.041769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833cc5a9-db06-4a37-b229-efe8c0cbd3d5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.047917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.048593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.049039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.053677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.053677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:08.055299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.058374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.073649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1011/2011] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:57:08.078325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.089190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c4b093-33c8-4ff5-82d3-7c28843f0153 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.094400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.095239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.095657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.096127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.096993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.100062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.353008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1001/2012] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:08 2022] POST /identity/v3/projects => generated 391 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:08.354513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.368646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539b897-bac7-44b9-b729-62cf5b0872fb admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.488324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.490047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.490489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.490922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.491762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.496584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.651978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1012/2013] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:08 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:08.656139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.669720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ffe39-64ff-49f9-81eb-4d2f81747ae5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.676417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.677421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.677852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.678269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.679072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.695582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.709792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1002/2014] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:08.713700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.724635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c765cd5-875b-4ef1-9a97-dd00d0bc2383 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.729646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.730302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.730729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.731139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.731805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.733465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa47fb4-6ce0-4243-9831-8b42a377bd0c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.761261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1013/2015] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:08.763627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:08.774792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8167d-c232-41d8-936b-3cfc10f41bd5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:08.779639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:08.780381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.780752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.781124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] PATH_INFO: `/v3/projects/7b8cfa7cef5a49c193be1d6e32f0e4b9/users/37072d91871e4684bceb177ac0139126/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:08.796813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b8cfa7cef5a49c193be1d6e32f0e4b9, user_id=37072d91871e4684bceb177ac0139126, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:08.799552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:08.965719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1003/2016] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:08 2022] PUT /identity/v3/projects/7b8cfa7cef5a49c193be1d6e32f0e4b9/users/37072d91871e4684bceb177ac0139126/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:08.979716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:08.980657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:08.981127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.032860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] MFA Rules not processed for user `37072d91871e4684bceb177ac0139126`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:09.034269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:09.160075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1014/2017] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:09.165798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:09.273097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a019f-9fb8-4654-968e-b6752c06b6c4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:09.278256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:09.279112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.279393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.279804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.280638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:09.282751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:09.453962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1004/2018] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:09 2022] POST /identity/v3/projects => generated 391 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:09.459662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:09.480778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685d1e-9b06-4a44-9e8c-655aab029e66 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:09.573243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:09.573903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.574198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.574453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.575710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:09.578227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:09.756005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1015/2019] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:09 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:09.760168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:09.772124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe4f36-c05e-43e5-bd7e-496e64179493 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:09.780900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:09.782090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.783035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.783335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.784324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:09.786763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc1fb9-45c3-4c11-9da9-d3da6961d5c9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:09.803565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1005/2020] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:09.804843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:09.821528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f31a3-4fb8-49d0-ab08-6603b72b85f8 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:09.826119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534b4f-ab74-4a99-9ebd-5d210d99208e None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.826495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534b4f-ab74-4a99-9ebd-5d210d99208e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.826840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc534b4f-ab74-4a99-9ebd-5d210d99208e None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.827532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:09.828362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1006/2021] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:57:09.828516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.828971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.829246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] PATH_INFO: `/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff/users/e80abbaeae5e49928d7b44a07b982e82/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.843876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:09.844607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:09.844966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:09.859284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e2f7e9acf94eba9693c50adfef51ff, user_id=e80abbaeae5e49928d7b44a07b982e82, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:09.863024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:09.890400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] MFA Rules not processed for user `776bd34229a4419495ec77bd62fb9ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:09.891641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:09.985080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1007/2022] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:57:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:10.003569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.006182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:10.014813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1016/2023] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:09 2022] PUT /identity/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff/users/e80abbaeae5e49928d7b44a07b982e82/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:10.017112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.022573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceabe7f3-20e0-4d59-a994-0e2ffa3e91da None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.090628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b8ffb-d143-44a6-854a-4df8ad3c7589 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.095439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.096060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.096337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.096608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.097732 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.099919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.111790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1017/2024] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:10.112014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.112673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.112989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.113343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.116383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.126297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.128809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803b83a-9238-401b-ab8b-f30e1fe63c5c service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.130841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c50f0c2-8ae6-434a-91e0-f5303bc0741f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.136032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.136935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.137449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.137868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] PATH_INFO: `/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff/users/e80abbaeae5e49928d7b44a07b982e82/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.140192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e2f7e9acf94eba9693c50adfef51ff, user_id=e80abbaeae5e49928d7b44a07b982e82, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.141028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1008/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:10.145450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.157807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1018/2026] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:10 2022] PUT /identity/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff/users/e80abbaeae5e49928d7b44a07b982e82/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:10.170397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.170683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.170953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.181816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.183795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:10.214575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] MFA Rules not processed for user `e80abbaeae5e49928d7b44a07b982e82`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:10.215889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:10.278067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21835ea-f212-4311-a592-02ec44595cd0 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.287472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.288185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.288545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.288910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] PATH_INFO: `/v3/users/3c08295ca49d491aab50e7b5fd300a71` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.291439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c08295ca49d491aab50e7b5fd300a71)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.293079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.340619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1009/2027] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:10.356990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.356990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:10.460029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06861ceb-3d5a-4cc3-ba16-8dd5b6cc2048 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.464290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.464993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.465274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.465739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.475882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.477389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.487866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1010/2028] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:10.557925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.567649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f8442-afe9-43cc-a651-c9ee2a980462 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:10.572317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:10.572966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:10.573250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:10.573524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:10.637701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c08295ca49d491aab50e7b5fd300a71'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:10.638370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c08295ca49d491aab50e7b5fd300a71'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:10.639043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c08295ca49d491aab50e7b5fd300a71'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:10.640889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:10.645212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:10.658435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1011/2029] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:10.816410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c08295ca49d491aab50e7b5fd300a71'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:10.826496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c08295ca49d491aab50e7b5fd300a71'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:10.846025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1019/2030] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:10 2022] DELETE /identity/v3/users/3c08295ca49d491aab50e7b5fd300a71 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:10.938188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:10.949364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:10.986861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d056b6-cf04-49ff-a5b3-4ff8cc57ac83 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:11.105656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:11.106722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.107215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.107698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] PATH_INFO: `/v3/users/92784971413b4b07b629140f3630fba7` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.109842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92784971413b4b07b629140f3630fba7)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:11.112866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:11.228118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:11.229086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.243109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83181d5b-a40c-42b3-937a-507bf3ad544e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:11.247899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:11.248837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.249194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.249568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] PATH_INFO: `/v3/projects/f10eff49529d4b38bd6adfc3c7f9347c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.250785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10eff49529d4b38bd6adfc3c7f9347c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:11.252859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:11.409977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92784971413b4b07b629140f3630fba7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.412178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92784971413b4b07b629140f3630fba7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.413018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92784971413b4b07b629140f3630fba7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.422915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92784971413b4b07b629140f3630fba7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.439524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-35cca000-c543-4a46-b081-b2ef68f195b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92784971413b4b07b629140f3630fba7'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.484622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10eff49529d4b38bd6adfc3c7f9347c', 'request_id': 'req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.491141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10eff49529d4b38bd6adfc3c7f9347c', 'request_id': 'req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.496605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10eff49529d4b38bd6adfc3c7f9347c', 'request_id': 'req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.696354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1012/2031] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:10 2022] DELETE /identity/v3/users/92784971413b4b07b629140f3630fba7 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:11.701072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.701356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.701627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.721018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:11.722223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.808501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1013/2032] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:11.819305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:11.820948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.823472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] The token cache is being invalidate because project f10eff49529d4b38bd6adfc3c7f9347c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:11.831711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.831711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d6fd5aa9-d1f1-4de9-a40f-6ee8c6772ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:11.831711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1020/2033] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:11 2022] DELETE /identity/v3/projects/f10eff49529d4b38bd6adfc3c7f9347c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:11.839814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03672-3819-48e8-bc42-96a88435c03b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.840314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03672-3819-48e8-bc42-96a88435c03b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.840613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d03672-3819-48e8-bc42-96a88435c03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.871103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-95d03672-3819-48e8-bc42-96a88435c03b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:11.872337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-95d03672-3819-48e8-bc42-96a88435c03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.881408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1021/2034] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:11.886430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14500a2e-647f-48c8-8065-4bb47b621bf7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:11.890048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.890265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:11.890406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.890583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.890880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.891160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.891433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.893217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.905921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:11.907416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:11.909714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:11.910941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:11.917733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1014/2035] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:11.918891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1022/2036] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:11.923173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:11.933318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2264e2-6eb2-439f-9964-b7659a7a3bf6 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:11.943041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:11.943755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:11.982866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1015/2037] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:11.985558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:11.986350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:11.989957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:12.000372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc18a91-dc8a-4fd5-aef2-fb97b5864ebd admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.007440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.008336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.009043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.009555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.010417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.011290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3bcd4-5c02-48bf-a44d-9be4b9127426 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.032597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.033164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.033164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.033164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.033164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] PATH_INFO: `/v3/users/1cf8ef2af56740a9a54b6a5fd1c2318a` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.033496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf8ef2af56740a9a54b6a5fd1c2318a)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.033496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.447842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1016/2038] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:11 2022] POST /identity/v3/projects => generated 365 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:12.452536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:12.468824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:12.549835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a3e8b-4118-481d-af4f-5985608f2504 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.555390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.556073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.556352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.556621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.557545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.559396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.634395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf8ef2af56740a9a54b6a5fd1c2318a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:12.635440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf8ef2af56740a9a54b6a5fd1c2318a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:12.636303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf8ef2af56740a9a54b6a5fd1c2318a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:12.729497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1017/2039] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:12 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:12.731216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:12.733125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:12.746472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf77c9-dcc9-4628-8031-47930390bba1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.751547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.752216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.752488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.752825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.753287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf8ef2af56740a9a54b6a5fd1c2318a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:12.753448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.755825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.762366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c43cfbc7-4703-478f-99d6-2b677608c636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf8ef2af56740a9a54b6a5fd1c2318a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:12.766623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1018/2040] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:12.771115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:12.781234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d506b-ba36-464b-aa96-48b67284035f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.783246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1023/2041] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:11 2022] DELETE /identity/v3/users/1cf8ef2af56740a9a54b6a5fd1c2318a => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:12.786636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.787230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.787504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.790160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.790160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.790160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.793355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.793638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.793914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.805595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1019/2042] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:12.806893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:12.810192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:12.815948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:12.817886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:12.818969 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218b69c-409a-4ac7-a606-4026c10c1275 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.892033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1024/2043] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:12.893307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:12.894991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:12.897380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.904002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.904298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.904609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] PATH_INFO: `/v3/projects/1fee9173c29f48eb891fbfeeecd4e4ea/users/1bf494c8dda44883bc36dcf70989f046/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.912519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22edd819-178d-4731-a6a7-f49f4a1d5b70 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:12.924217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:12.924382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:12.924954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:12.925233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] PATH_INFO: `/v3/projects/49da8ce5544544a79b2682c5c898132c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:12.927607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=49da8ce5544544a79b2682c5c898132c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.928389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fee9173c29f48eb891fbfeeecd4e4ea, user_id=1bf494c8dda44883bc36dcf70989f046, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:12.929799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:12.931292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.090649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1020/2044] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:12 2022] PUT /identity/v3/projects/1fee9173c29f48eb891fbfeeecd4e4ea/users/1bf494c8dda44883bc36dcf70989f046/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:13.091787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.093391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:13.148802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8cee-add6-42da-839d-5bffca78ef57 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.152424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.153063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.153343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.153615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.178554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49da8ce5544544a79b2682c5c898132c', 'request_id': 'req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.185701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49da8ce5544544a79b2682c5c898132c', 'request_id': 'req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.191284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49da8ce5544544a79b2682c5c898132c', 'request_id': 'req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.214842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.216386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc54b8-001f-4a0b-861b-759d465413c8 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.227066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1021/2045] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:13.228442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.228832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.229173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.260562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] MFA Rules not processed for user `1bf494c8dda44883bc36dcf70989f046`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:13.262111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:13.347786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1022/2046] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:13.353839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.391453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] The token cache is being invalidate because project 49da8ce5544544a79b2682c5c898132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:13.391750 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.392424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.393953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1025/2047] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:12 2022] DELETE /identity/v3/projects/49da8ce5544544a79b2682c5c898132c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:13.398786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.400308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:13.434718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01455546-bc7a-4f62-9b14-a51c01900079 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.447810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.448143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.448508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.448801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.449590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.451165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.482813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b7dc-e798-4990-b210-b8a64f67c2ab admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.488025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.488855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.489147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.489485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] PATH_INFO: `/v3/users/71ae68630b2945328382e1ce46c1a6a6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.496203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ae68630b2945328382e1ce46c1a6a6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.496203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.588469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1023/2048] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:13 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:13.592693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.594417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:13.693074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637887c-9aca-4743-923e-17c0d9e2067d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.698232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.698869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.699148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.699412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.700425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.702413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.838612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1024/2049] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:13 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:13.839850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.846835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ae68630b2945328382e1ce46c1a6a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.848078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ae68630b2945328382e1ce46c1a6a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.848949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ae68630b2945328382e1ce46c1a6a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.851761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb96c7-6f77-48a4-8221-027f05b51c21 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.856834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.857452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.857728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.857995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.858644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.860266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.873292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1025/2050] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:13.877817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:13.880299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:13.893686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe450ace-727e-4ce8-b891-bfa18643db7f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:13.899308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:13.900071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:13.900414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:13.900691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] PATH_INFO: `/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9/users/cd46b2f936524b36a885f3d25d0e5c91/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:13.917727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeee55c357504d1f9cc07d8558e5c1d9, user_id=cd46b2f936524b36a885f3d25d0e5c91, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:13.920676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:13.970716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ae68630b2945328382e1ce46c1a6a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.979774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ae68630b2945328382e1ce46c1a6a6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:13.998550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1026/2051] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:13 2022] DELETE /identity/v3/users/71ae68630b2945328382e1ce46c1a6a6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:13.999649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.003321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.079845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea75dd1-84c6-4361-b3fe-9bde268deb00 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.084771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.085408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.085680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.085950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] PATH_INFO: `/v3/projects/d51d97670b3943a783f5e81d68db2b54` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.087072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d51d97670b3943a783f5e81d68db2b54)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.089190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.137158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1026/2052] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:13 2022] PUT /identity/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9/users/cd46b2f936524b36a885f3d25d0e5c91/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:14.141071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.203412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e845-d1ce-47bf-85a0-988f8737de73 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.208264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.208913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.209201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.209477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.210164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.211784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.222244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1027/2053] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:14.226885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.237420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0535d3-dd7a-4192-bf96-598b8b0c3cdb admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.242977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.243684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.243920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.244199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] PATH_INFO: `/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9/users/cd46b2f936524b36a885f3d25d0e5c91/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.246185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeee55c357504d1f9cc07d8558e5c1d9, user_id=cd46b2f936524b36a885f3d25d0e5c91, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.248883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9a595-91e3-4238-ad31-3244bca055df admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.260120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1028/2054] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:14 2022] PUT /identity/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9/users/cd46b2f936524b36a885f3d25d0e5c91/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:14.271897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.272181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.272452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.301360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] MFA Rules not processed for user `cd46b2f936524b36a885f3d25d0e5c91`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:14.302823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.333434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd51d97670b3943a783f5e81d68db2b54', 'request_id': 'req-63126c80-cd83-4e63-befe-c40747587c23'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.340271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd51d97670b3943a783f5e81d68db2b54', 'request_id': 'req-63126c80-cd83-4e63-befe-c40747587c23'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.346800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd51d97670b3943a783f5e81d68db2b54', 'request_id': 'req-63126c80-cd83-4e63-befe-c40747587c23'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.390777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1029/2055] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:14.403324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.405026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.455695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] The token cache is being invalidate because project d51d97670b3943a783f5e81d68db2b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:14.455695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.455695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.457591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1027/2056] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:13 2022] DELETE /identity/v3/projects/d51d97670b3943a783f5e81d68db2b54 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:14.462322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.465324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.498887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4162a-ae79-4734-a0e0-998847c99fdb None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.543110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63126c80-cd83-4e63-befe-c40747587c23 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.549085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.549715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.550191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.550459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] PATH_INFO: `/v3/users/c2801c65f3e54b94a13156e1f3f9bf7b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.552490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2801c65f3e54b94a13156e1f3f9bf7b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.554623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.555388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.556034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.556314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.556586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.558373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.630368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.630368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.639079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1030/2057] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:14.664072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.665570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:14.686806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cd5c1-a3d6-4754-bcd0-0e74c4826907 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:14.693734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:14.694749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:14.695042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:14.695418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] PATH_INFO: `/v3/projects/d9a5c3a2473a45bc8ae85b1d5510bc1e` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:14.699176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a5c3a2473a45bc8ae85b1d5510bc1e)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:14.699388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:14.810096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2801c65f3e54b94a13156e1f3f9bf7b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.810858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2801c65f3e54b94a13156e1f3f9bf7b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.811552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2801c65f3e54b94a13156e1f3f9bf7b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.908239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a5c3a2473a45bc8ae85b1d5510bc1e', 'request_id': 'req-4e376239-bea9-4c52-b1be-cc61f516b067'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.934851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2801c65f3e54b94a13156e1f3f9bf7b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.950714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2801c65f3e54b94a13156e1f3f9bf7b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:14.991813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1028/2058] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:14 2022] DELETE /identity/v3/users/c2801c65f3e54b94a13156e1f3f9bf7b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:14.993977 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:14.995463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.034535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:15.041402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a5c3a2473a45bc8ae85b1d5510bc1e', 'request_id': 'req-4e376239-bea9-4c52-b1be-cc61f516b067'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.061241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a5c3a2473a45bc8ae85b1d5510bc1e', 'request_id': 'req-4e376239-bea9-4c52-b1be-cc61f516b067'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.081753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] The token cache is being invalidate because project d9a5c3a2473a45bc8ae85b1d5510bc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:15.083542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.084679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.086763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1031/2059] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:14 2022] DELETE /identity/v3/projects/d9a5c3a2473a45bc8ae85b1d5510bc1e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:15.091548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:15.094734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.111808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d445865-7f93-43b8-84d2-1297b05cc2be admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:15.116961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:15.117898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:15.121679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:15.121679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:15.121679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.204119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:15.205691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:15.214678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376239-bea9-4c52-b1be-cc61f516b067 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:15.235273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1029/2060] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:15.298251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:15.298894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:15.299172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:15.299440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] PATH_INFO: `/v3/users/2fa0dab861cd41acaeb42d44e0ac3424` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:15.300597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa0dab861cd41acaeb42d44e0ac3424)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:15.302842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:15.574357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:15.575571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:15.587229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa0dab861cd41acaeb42d44e0ac3424'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.587914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa0dab861cd41acaeb42d44e0ac3424'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.588536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa0dab861cd41acaeb42d44e0ac3424'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.591478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa05f9f-1c80-45fe-a46c-d2fd3cafb2fd service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:15.597046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:15.598044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:15.598298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:15.598577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] PATH_INFO: `/v3/projects/95cef30df4f541378bf358d944b3bfec` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:15.600367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cef30df4f541378bf358d944b3bfec)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:15.609329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:15.609965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa0dab861cd41acaeb42d44e0ac3424'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.621332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3f75277e-0b8b-4f5c-b25e-ae0c55c3a972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa0dab861cd41acaeb42d44e0ac3424'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.799708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1032/2061] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:15 2022] DELETE /identity/v3/users/2fa0dab861cd41acaeb42d44e0ac3424 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:15.812163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cef30df4f541378bf358d944b3bfec', 'request_id': 'req-a223a12f-4997-43cc-852b-84d407d34d36'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.821762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cef30df4f541378bf358d944b3bfec', 'request_id': 'req-a223a12f-4997-43cc-852b-84d407d34d36'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.825311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cef30df4f541378bf358d944b3bfec', 'request_id': 'req-a223a12f-4997-43cc-852b-84d407d34d36'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:15.999535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] The token cache is being invalidate because project 95cef30df4f541378bf358d944b3bfec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:16.000161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.000511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a223a12f-4997-43cc-852b-84d407d34d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.002246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1030/2062] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:15 2022] DELETE /identity/v3/projects/95cef30df4f541378bf358d944b3bfec => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:16.007152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.007464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.007766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.027197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:16.028418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:16.089054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1033/2063] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:16.096816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.097179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.097367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.131553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:16.132798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:16.141061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1031/2064] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:16.150675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.161171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89772459-95c3-4b2d-8bda-965716c73f39 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.165933 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.166541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.166814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.167143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.167798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:16.168099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.169823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.193677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1034/2065] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:16.196846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.207958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8498d1-ff6a-4a27-9d20-41ef3e92db5e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.212975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.213706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.214045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.214418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.215093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.217350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.256423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:16.438305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1032/2066] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:16.438799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.439213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:16.441769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.462636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3ce71-aaf8-40a4-b054-deba651a5fdb admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.515383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03935106-ca46-49bd-bd12-b5efc9474d57 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.520706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.521349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.521623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.521889 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.522518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.524490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.567422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.568080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.568370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.568641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] PATH_INFO: `/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.569843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef7ae86b7ea409f8542d2dd6537f9b4)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.571808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.710512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1033/2067] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:16.717519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.727261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef7ae86b7ea409f8542d2dd6537f9b4', 'request_id': 'req-9acb017b-bab9-462c-8333-8eed850c3047'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.730225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10629d12-4d96-412b-8d8b-8fad178b5845 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.804442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.805205 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.805481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.805748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.806452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.817133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.827630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1034/2068] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:16.832773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.843206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe8fb3-f147-4e2c-a025-0eae55fced26 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.848605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.849327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.849604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.849876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.850519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.852133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.862569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1035/2069] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:16.867001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:16.877142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67736a-fa7e-40fa-af79-30c632d48fd2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:16.882947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:16.885881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.885881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.885881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] PATH_INFO: `/v3/projects/193b121d5d2944f3898cb120e7f2107c/users/5c3db6eaba554be498e3cc83a240ac56/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.908299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=193b121d5d2944f3898cb120e7f2107c, user_id=5c3db6eaba554be498e3cc83a240ac56, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:16.911156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e1c16-e4d1-442f-9dfd-7c5baca81003 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:16.913052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef7ae86b7ea409f8542d2dd6537f9b4', 'request_id': 'req-9acb017b-bab9-462c-8333-8eed850c3047'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.919867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef7ae86b7ea409f8542d2dd6537f9b4', 'request_id': 'req-9acb017b-bab9-462c-8333-8eed850c3047'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.933333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] The token cache is being invalidate because project 1ef7ae86b7ea409f8542d2dd6537f9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:16.933625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.934300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9acb017b-bab9-462c-8333-8eed850c3047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:16.935833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1035/2070] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:16 2022] DELETE /identity/v3/projects/1ef7ae86b7ea409f8542d2dd6537f9b4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:16.941885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e649-b61b-4c87-bc57-78bda26478b4 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.942341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e649-b61b-4c87-bc57-78bda26478b4 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.942583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21e649-b61b-4c87-bc57-78bda26478b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:16.962794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-2c21e649-b61b-4c87-bc57-78bda26478b4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:16.963963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2c21e649-b61b-4c87-bc57-78bda26478b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:16.972370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1036/2071] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:16.980369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:16.980647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:16.981001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.000572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:17.001855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:17.010585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1037/2072] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:17.015003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.025333 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f937f-25ff-4516-b885-58a4e257dc38 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.030156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.030782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.031054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.031374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.032032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:17.032330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.034037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.046754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1038/2073] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:57:17.057598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.069273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8575b-e6cc-4285-b2ec-45695ced6798 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.074433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.075035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.075312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.075582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.076208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.078556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.131016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1036/2074] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:16 2022] PUT /identity/v3/projects/193b121d5d2944f3898cb120e7f2107c/users/5c3db6eaba554be498e3cc83a240ac56/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:17.142466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.142747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.143036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.171028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] MFA Rules not processed for user `5c3db6eaba554be498e3cc83a240ac56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:17.172239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:17.239884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1037/2075] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:17.244785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.246131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:17.252018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1039/2076] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:17.259972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.323098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad6291-a4fa-40d3-983f-17bc664b4de1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.328164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.328985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.329268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.329372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d9910-5252-4bbe-9fca-39d900ffaa73 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.329530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.330162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.332151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.335084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.335842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.336190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.336526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.337405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.339631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.503198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1040/2077] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:17.509043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.514038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1038/2078] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:17.519991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69337f8-4397-4cf0-b85a-83ff9b0d349c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.521253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.630654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.631684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.631962 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.632235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.632919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.634902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.636962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1dcf-9194-4225-aec8-28fb38795f11 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.642179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.642896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.643349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.644540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.644540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.646354 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.650517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1041/2079] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:17.656823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.667628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97a0e9-6f9a-41ca-99c0-4710b957e67d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.672442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.673092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.673375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.673646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.674294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.676482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.688649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1042/2080] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:17.694018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.705212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8318451-6db6-4d14-9558-84e863395160 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.711893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.712590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.712935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.713210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] PATH_INFO: `/v3/projects/4870c55276fe40509c24469fa33a8ca0/users/233343f16c8e426d9633936ecc6705c3/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.729553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4870c55276fe40509c24469fa33a8ca0, user_id=233343f16c8e426d9633936ecc6705c3, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.732557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6dbca5-df14-4947-9810-f68d7df37acb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.827471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:17.835510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1039/2081] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/users => generated 289 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:17.839319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.850921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c43bc-9dd9-421d-a06d-03f498495f09 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.856519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.857306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.857790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.858244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.858897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.866993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.878298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1040/2082] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:17.878298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:17.887988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbd2e7-cc99-486b-af0f-7f3f30c1b356 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:17.895855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:17.896593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.896966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.897339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] PATH_INFO: `/v3/projects/21f799a0418f43a793b37a41fee76c1c/users/20450361e40045f9ac40c646f8150951/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.915605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1043/2083] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:17 2022] PUT /identity/v3/projects/4870c55276fe40509c24469fa33a8ca0/users/233343f16c8e426d9633936ecc6705c3/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:17.917565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f799a0418f43a793b37a41fee76c1c, user_id=20450361e40045f9ac40c646f8150951, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:17.918823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:17.927810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:17.928181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:17.928456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:17.958582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] MFA Rules not processed for user `233343f16c8e426d9633936ecc6705c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:17.959791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:18.029704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1044/2084] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:18.109488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:18.110972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:18.169213 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1041/2085] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:17 2022] PUT /identity/v3/projects/21f799a0418f43a793b37a41fee76c1c/users/20450361e40045f9ac40c646f8150951/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:18.174037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:18.184838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91f0b2-915e-44f9-9dad-dcb916b918a1 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:18.234947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:18.235570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:18.235897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:18.236171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:18.237264 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86184f8-fb1b-422a-b483-aa0af0bf476b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:18.242128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:18.242733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:18.243010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:18.243277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:18.243950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:18.245575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:18.255989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1042/2086] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:18.260349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:18.270665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ea738-ee00-4d43-82a1-5292df39b752 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:18.275268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:18.281267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:18.281267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:18.281267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] PATH_INFO: `/v3/projects/21f799a0418f43a793b37a41fee76c1c/users/20450361e40045f9ac40c646f8150951/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:18.281267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f799a0418f43a793b37a41fee76c1c, user_id=20450361e40045f9ac40c646f8150951, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:18.281267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0686b07-4728-4d69-a088-aa49569cc765 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:18.292877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1043/2087] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:18 2022] PUT /identity/v3/projects/21f799a0418f43a793b37a41fee76c1c/users/20450361e40045f9ac40c646f8150951/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:18.296746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:18.298218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:18.302304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:18.302613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:18.302884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:18.308265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1045/2088] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:18.334089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] MFA Rules not processed for user `20450361e40045f9ac40c646f8150951`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:18.335434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:18.410624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1044/2089] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:19.022995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:19.024515 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:19.037131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:19.041765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07902d-8e6b-466f-90d5-41c94654ea59 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:19.053568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:19.055605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:19.106102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:19.106749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:19.107021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:19.107293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] PATH_INFO: `/v3/users/37072d91871e4684bceb177ac0139126` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:19.108471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37072d91871e4684bceb177ac0139126)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:19.110453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:19.119340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73fb2f-63ca-462d-96d9-37eda5868e09 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:19.123672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:19.124287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:19.124561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:19.124872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:19.134435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:19.135921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd97edd-3c93-475c-b6be-375b49b3e0d8 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:19.145990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1045/2090] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:19.416975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37072d91871e4684bceb177ac0139126'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:19.417844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37072d91871e4684bceb177ac0139126'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:19.418533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37072d91871e4684bceb177ac0139126'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:19.430426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37072d91871e4684bceb177ac0139126'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:19.446416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37072d91871e4684bceb177ac0139126'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:19.644516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1046/2091] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:19 2022] DELETE /identity/v3/users/37072d91871e4684bceb177ac0139126 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:19.809847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:19.811969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:19.812580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:19.826836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:19.829565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:19.842601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:19.844538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:19.906841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b2271-3aff-4c02-b929-c1c8d0c6e8d4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:19.911516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:19.911886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:19.912174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:19.912430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:19.914397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:19.946868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1046/2092] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:19.966382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:19.970491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:20.005283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:20.015510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:20.032899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1047/2093] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:20.083733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60488f7-3fa7-491e-8a6b-35e49acce02b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:20.089369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:20.090341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:20.090915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:20.091129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:20.105842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:20.109146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:20.122180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1047/2094] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:21.139487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:21.141095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:21.157820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc09bb-3f4f-4a67-ad22-ff226fa761b0 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:21.169945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:21.170663 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:21.170940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:21.171210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] PATH_INFO: `/v3/projects/7b8cfa7cef5a49c193be1d6e32f0e4b9` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:21.172329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b8cfa7cef5a49c193be1d6e32f0e4b9)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:21.174342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:21.356471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b8cfa7cef5a49c193be1d6e32f0e4b9', 'request_id': 'req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.473774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b8cfa7cef5a49c193be1d6e32f0e4b9', 'request_id': 'req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.480390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b8cfa7cef5a49c193be1d6e32f0e4b9', 'request_id': 'req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.493141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] The token cache is being invalidate because project 7b8cfa7cef5a49c193be1d6e32f0e4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:21.493431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.494099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.495608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1048/2095] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:21 2022] DELETE /identity/v3/projects/7b8cfa7cef5a49c193be1d6e32f0e4b9 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:21.499919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:21.510217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79174-8d19-4fa5-be9b-9c583ae777f8 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:21.600301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:21.601597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:21.602066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:21.602544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] PATH_INFO: `/v3/users/e80abbaeae5e49928d7b44a07b982e82` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:21.604202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80abbaeae5e49928d7b44a07b982e82)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:21.607399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:21.635146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:21.637609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:21.663935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6b03c-6dee-4a8c-86ff-8562cbc3e43e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:21.683288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:21.683288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:21.683288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:21.683288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] PATH_INFO: `/v3/users/1bf494c8dda44883bc36dcf70989f046` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:21.684312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf494c8dda44883bc36dcf70989f046)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:21.684312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:21.954568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80abbaeae5e49928d7b44a07b982e82'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.955221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80abbaeae5e49928d7b44a07b982e82'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:21.955818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80abbaeae5e49928d7b44a07b982e82'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.061698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80abbaeae5e49928d7b44a07b982e82'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.072042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2cc7ee8a-5f37-4b7d-a1ec-a08f645b830b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80abbaeae5e49928d7b44a07b982e82'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.091123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1048/2096] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:21 2022] DELETE /identity/v3/users/e80abbaeae5e49928d7b44a07b982e82 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:22.112198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf494c8dda44883bc36dcf70989f046'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.113069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf494c8dda44883bc36dcf70989f046'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.114365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf494c8dda44883bc36dcf70989f046'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.138609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf494c8dda44883bc36dcf70989f046'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.153484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf494c8dda44883bc36dcf70989f046'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:22.308026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:22.313132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1049/2097] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:21 2022] DELETE /identity/v3/users/1bf494c8dda44883bc36dcf70989f046 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:22.318245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:22.323523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:22.323523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:22.338465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:22.339695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:22.402218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1049/2098] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:22.412188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:22.414326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:22.478203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407213b-ee33-48da-b2a3-9dbd39d86823 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:22.481888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:22.482503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:22.482814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:22.483063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:22.494062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:22.495510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:22.505888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1050/2099] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:22.816291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:22.817888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:22.831243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2671-bd8c-4d39-9699-e09ebbbe368a None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:22.836332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:22.837221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:22.837651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:22.837918 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] PATH_INFO: `/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:22.839206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e2f7e9acf94eba9693c50adfef51ff)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:22.841284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.052025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e2f7e9acf94eba9693c50adfef51ff', 'request_id': 'req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.058389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e2f7e9acf94eba9693c50adfef51ff', 'request_id': 'req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.064048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e2f7e9acf94eba9693c50adfef51ff', 'request_id': 'req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.156774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.158242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.171693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a494948-e2dd-44a8-b840-6881305c1a5b service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.232044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] The token cache is being invalidate because project a4e2f7e9acf94eba9693c50adfef51ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:23.232258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.232372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.235875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.235994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.236097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.236097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] PATH_INFO: `/v3/users/233343f16c8e426d9633936ecc6705c3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.236268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1050/2100] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:22 2022] DELETE /identity/v3/projects/a4e2f7e9acf94eba9693c50adfef51ff => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:23.236348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233343f16c8e426d9633936ecc6705c3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:23.236512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.237618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.239964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.253218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d3826-0f32-4a7b-b1b9-bf3672e282ae admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.258127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.258762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.259175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.259431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] PATH_INFO: `/v3/projects/1fee9173c29f48eb891fbfeeecd4e4ea` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.260646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fee9173c29f48eb891fbfeeecd4e4ea)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:23.262638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.489560 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fee9173c29f48eb891fbfeeecd4e4ea', 'request_id': 'req-14ffab91-4446-461e-a99d-089fe1d3d5b0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.490323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fee9173c29f48eb891fbfeeecd4e4ea', 'request_id': 'req-14ffab91-4446-461e-a99d-089fe1d3d5b0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.495540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233343f16c8e426d9633936ecc6705c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.500327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fee9173c29f48eb891fbfeeecd4e4ea', 'request_id': 'req-14ffab91-4446-461e-a99d-089fe1d3d5b0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.500464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233343f16c8e426d9633936ecc6705c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.500464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233343f16c8e426d9633936ecc6705c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.507707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233343f16c8e426d9633936ecc6705c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.519998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b46ec915-2e72-4394-9974-3af4ae9357d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233343f16c8e426d9633936ecc6705c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.610375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] The token cache is being invalidate because project 1fee9173c29f48eb891fbfeeecd4e4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:23.610671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.611442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-14ffab91-4446-461e-a99d-089fe1d3d5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:23.613113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1051/2101] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:23 2022] DELETE /identity/v3/projects/1fee9173c29f48eb891fbfeeecd4e4ea => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:23.614467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.616958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.616958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.618426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:23.636824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:23.640074 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.672108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1051/2102] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:23 2022] DELETE /identity/v3/users/233343f16c8e426d9633936ecc6705c3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:23.673660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896b4b-8067-44ff-9d62-efa69b8ae8a0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.678160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896b4b-8067-44ff-9d62-efa69b8ae8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.678160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0896b4b-8067-44ff-9d62-efa69b8ae8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.693911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a0896b4b-8067-44ff-9d62-efa69b8ae8a0 None None] MFA Rules not processed for user `2d787e88278341b69b9f1ca9f052fb56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:23.695117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a0896b4b-8067-44ff-9d62-efa69b8ae8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.699556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1052/2103] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:23.700484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.701763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.714865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e8553-9a57-42cb-8004-a0f1c69220a6 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.753291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1052/2104] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:23.755213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b59-8502-40d1-aff4-f768e28f7390 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.755509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b59-8502-40d1-aff4-f768e28f7390 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.756122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d3b59-8502-40d1-aff4-f768e28f7390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.772552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.773353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.773649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.773926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] PATH_INFO: `/v3/users/cd46b2f936524b36a885f3d25d0e5c91` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.775038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3f5d3b59-8502-40d1-aff4-f768e28f7390 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:23.775169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd46b2f936524b36a885f3d25d0e5c91)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:23.776359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3f5d3b59-8502-40d1-aff4-f768e28f7390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.777164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.784355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1053/2105] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:23.787106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.787455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.788353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.811389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:23.812664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.821959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1054/2106] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:23.825303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.825303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:23.882560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c52f1-55db-4266-b90c-29c9582d7617 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.886749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.887592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.887871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.888143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.899556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:23.901210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.913231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1055/2107] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:23.914103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.924613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af2d28f-015d-40be-a3a3-878be2dbfd26 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.930746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.931493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.931845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.932196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.932957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:23.933464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:23.935158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:23.964350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1056/2108] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:23.965808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:23.978529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a89259-326f-4082-9aa3-3bf1dcedfb47 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:23.986862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:23.989055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:23.989055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:23.989055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:23.989055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.001957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:24.117419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd46b2f936524b36a885f3d25d0e5c91'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:24.118583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd46b2f936524b36a885f3d25d0e5c91'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:24.120512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd46b2f936524b36a885f3d25d0e5c91'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:24.197668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1057/2109] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:23 2022] POST /identity/v3/projects => generated 401 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:24.204108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:24.209090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:24.297213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce0f6a-a457-4b3e-a8d6-a8cfe3923bc7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:24.303708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:24.303708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:24.303708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:24.303708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:24.304454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.306684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:24.359800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd46b2f936524b36a885f3d25d0e5c91'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:24.372678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd46b2f936524b36a885f3d25d0e5c91'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:24.387639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1053/2110] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:23 2022] DELETE /identity/v3/users/cd46b2f936524b36a885f3d25d0e5c91 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:24.577698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1058/2111] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:24 2022] POST /identity/v3/users => generated 301 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:24.591961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:24.633640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:24.635628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:24.669277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080028f-e01d-4760-84cd-1b8bdbb05d88 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:24.723407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227948d-2ddb-4ab4-9e84-9b948d501ded admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:24.729097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:24.734854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:24.734854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:24.734854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:24.734854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.734854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:24.756688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1054/2112] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:24.757690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:24.767988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:24.769058 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:24.770185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:24.770780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] PATH_INFO: `/v3/projects/4870c55276fe40509c24469fa33a8ca0` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:24.771648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f40556-2b52-4ef0-9821-84b765c1c5a6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:24.773275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4870c55276fe40509c24469fa33a8ca0)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.775805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:24.779004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:24.779710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:24.785405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:24.785405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:24.786544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.794782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:24.808791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1055/2113] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:24.817747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:24.833552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09b73d-a933-45f7-96c9-06da9a4cd195 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:24.838035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:24.838707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:24.838986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:24.839575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] PATH_INFO: `/v3/projects/679d8ea6e8524e2db93914ca3397fe86/users/298a95bbcd164d3e8f52943a91406515/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:24.860317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=679d8ea6e8524e2db93914ca3397fe86, user_id=298a95bbcd164d3e8f52943a91406515, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:24.866316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127a5ed-a7d8-4fe2-a04a-9b30760a8b6a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:25.186652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1056/2114] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:24 2022] PUT /identity/v3/projects/679d8ea6e8524e2db93914ca3397fe86/users/298a95bbcd164d3e8f52943a91406515/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:25.195418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4870c55276fe40509c24469fa33a8ca0', 'request_id': 'req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.205001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:25.213590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:25.213590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:25.248195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] MFA Rules not processed for user `298a95bbcd164d3e8f52943a91406515`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:25.249572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:25.296752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4870c55276fe40509c24469fa33a8ca0', 'request_id': 'req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.306635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4870c55276fe40509c24469fa33a8ca0', 'request_id': 'req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.328749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] The token cache is being invalidate because project 4870c55276fe40509c24469fa33a8ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:25.329673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.332246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.335455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1057/2115] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:25.336973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:25.337261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1059/2116] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:24 2022] DELETE /identity/v3/projects/4870c55276fe40509c24469fa33a8ca0 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:25.339724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:25.345468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:25.355467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:25.450892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3a36d-2f6c-4ba0-a9c8-0772b2a71a72 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:25.455908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:25.456436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:25.456837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:25.457244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:25.457818 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:25.459940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7f467-8eb9-4af0-bf49-b156bc7e14ef admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:25.475564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aacdc0-4462-4ae0-aa70-81c001296c4b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:25.480442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:25.483433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:25.483433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:25.483433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] PATH_INFO: `/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:25.483433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeee55c357504d1f9cc07d8558e5c1d9)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:25.484768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:25.674994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1060/2117] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:25 2022] POST /identity/v3/projects => generated 401 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:25.679907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:25.680195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:25.680512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:25.689808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeee55c357504d1f9cc07d8558e5c1d9', 'request_id': 'req-68564de2-c1e5-467d-9676-1ba562a3570c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.697714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeee55c357504d1f9cc07d8558e5c1d9', 'request_id': 'req-68564de2-c1e5-467d-9676-1ba562a3570c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.705665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeee55c357504d1f9cc07d8558e5c1d9', 'request_id': 'req-68564de2-c1e5-467d-9676-1ba562a3570c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:25.710871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:25.712800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:25.780109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1061/2118] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:25.780954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:25.796066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e487c92d-d8f3-4785-92a0-3ed516d3b78a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:25.800791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:25.802709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:25.802709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:25.802709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:25.802709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:25.804605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.010373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] The token cache is being invalidate because project aeee55c357504d1f9cc07d8558e5c1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:26.011087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:26.011755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-68564de2-c1e5-467d-9676-1ba562a3570c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:26.013324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1058/2119] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:25 2022] DELETE /identity/v3/projects/aeee55c357504d1f9cc07d8558e5c1d9 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:26.014508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a1b-c732-462d-a6c8-66ebcc766167 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.014785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a1b-c732-462d-a6c8-66ebcc766167 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.015170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d29a1b-c732-462d-a6c8-66ebcc766167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.035558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-52d29a1b-c732-462d-a6c8-66ebcc766167 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:26.036784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-52d29a1b-c732-462d-a6c8-66ebcc766167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.044941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1059/2120] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:26.046115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.046536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.046717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.071061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1062/2121] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:25 2022] POST /identity/v3/users => generated 307 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:26.072030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.072457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:26.074069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.083355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1060/2122] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:26.083570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f17eb6-ee16-4f8d-85b5-dc64d961dd43 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.084846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.088149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.089386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.090218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.090493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.090760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.091408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:26.091708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.093344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5bd3d-808a-4d24-87ce-1d11a10081f8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.102733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66e30-aa55-41ac-93ce-7c4b137920a4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.107481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.108142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.108419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.108818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.109761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.111014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.116918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1063/2123] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:26.116918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.116918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.116918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.128568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1061/2124] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:26.130805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.143031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:26.143031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.144981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a489d-63cd-4f2f-b2f1-0b75c024e9b5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.150384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1064/2125] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:26.150510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.150851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.151235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.151353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.151542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.152197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.154320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.162441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1062-21ab-4540-ab7a-c59db9973c00 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.167580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.168342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.168620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.168941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] PATH_INFO: `/v3/projects/78cca9e8264d4201804246dd0d893ca2/users/aa6b580050ba44f8920e677b46a11032/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.185501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cca9e8264d4201804246dd0d893ca2, user_id=aa6b580050ba44f8920e677b46a11032, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.188291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.377615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1062/2126] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:26.379755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.417491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1065/2127] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:26 2022] PUT /identity/v3/projects/78cca9e8264d4201804246dd0d893ca2/users/aa6b580050ba44f8920e677b46a11032/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:26.418365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.464194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d2e85-8b86-4c6d-b40f-a64f83cccbe4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.490939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83616381-e09b-44ef-a4d0-aa9d51e77ca8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.499991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.500692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.501157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.501500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.502203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.504231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.530103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.530712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.530990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.531259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.531908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:26.532209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.533920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.546417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1063/2128] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:26.547567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.561678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc418f3-ae51-48c3-a410-a109db44f206 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.566718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.567455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.567598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.567866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.568644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.572575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.585360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1064/2129] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:26.590053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.596883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9140-c756-4b83-8880-efc0f1b5fedd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.602911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.603749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.603749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.604146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.604642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.606576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61570248-9bff-41b2-bc3b-0b19adca8e72 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.627996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1066/2130] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:26.629121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.639963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87e792-be71-48a3-bec9-0de0a1fa252b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.651360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:26.661638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.663090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.664849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.664849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] PATH_INFO: `/v3/projects/78cca9e8264d4201804246dd0d893ca2/users/aa6b580050ba44f8920e677b46a11032/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.665637 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78cca9e8264d4201804246dd0d893ca2, user_id=aa6b580050ba44f8920e677b46a11032, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.677024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.696033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1067/2131] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:26 2022] PUT /identity/v3/projects/78cca9e8264d4201804246dd0d893ca2/users/aa6b580050ba44f8920e677b46a11032/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:26.697181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.733802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1065/2132] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:26.741532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905375a-716e-4791-8e85-2c42161b30df None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.741532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905375a-716e-4791-8e85-2c42161b30df None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.741532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905375a-716e-4791-8e85-2c42161b30df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.770914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d6c42-cac0-4dd5-87b2-f363b3f352a4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.776788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8905375a-716e-4791-8e85-2c42161b30df None None] MFA Rules not processed for user `aa6b580050ba44f8920e677b46a11032`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:26.776788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8905375a-716e-4791-8e85-2c42161b30df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.833478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.834128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.834412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.834685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.835328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.836972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.849426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1068/2133] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:26.850378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.867004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1066/2134] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:26.867004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905375a-716e-4791-8e85-2c42161b30df None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.867302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0b222-4534-4d64-83b6-346978551e1c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.869434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905375a-716e-4791-8e85-2c42161b30df None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.874658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.875260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.875542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.875813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.876476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.878216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.881826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.882460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.882739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.883008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.883655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.885604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:26.903526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1067/2135] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:26.903526 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:26.910863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:26.982390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5b43e-a369-449f-8574-36e07fbc1b98 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:26.986224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:26.986828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:26.987100 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:26.987368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:26.997092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:26.999023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.006119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1069/2136] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:26 2022] POST /identity/v3/users => generated 284 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:27.007030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.017323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818d55-2042-4c91-b53a-cffaf3d26c71 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.021449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1068/2137] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:26 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:27.022343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.025689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.026364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.026641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.027055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] PATH_INFO: `/v3/projects/c971afe1aabd46888d53b253eac6c54d/users/3e79e8dbf9b24efcbfbd2c1e6f47e5ee/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.033333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921af9b-7eef-4279-a24d-d79427160796 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.038623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.039224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.039497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.039763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.040460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.042254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.044083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c971afe1aabd46888d53b253eac6c54d, user_id=3e79e8dbf9b24efcbfbd2c1e6f47e5ee, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.047356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057b59b-a86e-43e0-8dc8-5a7b7e84821c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.052928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1069/2138] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:27.064146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.075234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee731d21-4f6e-4740-8c73-a971a9d42ca4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.080293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.080915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.081197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.081471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.082726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.084335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.094970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1070/2139] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:27.099990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.109247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8aca8-adc6-491c-b59d-9dedc58c59ea admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.114093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.118585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.118585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.118585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] PATH_INFO: `/v3/projects/f60cf30b8d374789ae187df36c4bea81/users/10a5da0f860d40b88f74018ef03d8804/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.131269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f60cf30b8d374789ae187df36c4bea81, user_id=10a5da0f860d40b88f74018ef03d8804, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.133941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180ddaa-0ec1-4b0d-aa0e-4e63d349327a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.247920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1071/2141] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:27 2022] PUT /identity/v3/projects/f60cf30b8d374789ae187df36c4bea81/users/10a5da0f860d40b88f74018ef03d8804/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:27.248471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1070/2141] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:27 2022] PUT /identity/v3/projects/c971afe1aabd46888d53b253eac6c54d/users/3e79e8dbf9b24efcbfbd2c1e6f47e5ee/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:27.250278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.250572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.250850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.258231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0262-f41a-445c-a969-68146469e96e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.258600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0262-f41a-445c-a969-68146469e96e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.258970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f0262-f41a-445c-a969-68146469e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.274229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:27.275584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:27.295095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b02f0262-f41a-445c-a969-68146469e96e None None] MFA Rules not processed for user `10a5da0f860d40b88f74018ef03d8804`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:27.296395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b02f0262-f41a-445c-a969-68146469e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:27.343466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1072/2142] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:27.353966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.355471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:27.368102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1071/2143] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:27.372364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f0262-f41a-445c-a969-68146469e96e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.386480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f0262-f41a-445c-a969-68146469e96e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.397370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.399211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.399751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.400177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.401332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.404203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.424869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbeb45-417a-447d-89aa-57bc7a626e2b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.429437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.430040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.430316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.430585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.440253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.453296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.453296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1073/2144] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:27.460902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.514894 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5213-f5fc-41eb-9ae3-d4d80910f476 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.518635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.519270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.519549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.519821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.521719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:27.582363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.583933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.593821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1074/2145] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:27 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:27.651904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1072/2146] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:27 2022] POST /identity/v3/projects => generated 367 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:27.654078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:27.667680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753552fd-0484-40f7-b035-303a7dcf0016 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:27.768001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:27.768611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:27.768902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:27.769323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:27.770130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:27.771877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:27.772078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:27.998611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1075/2147] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:27 2022] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:28.000342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.010785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322cc15-8e66-4619-8683-3a57b525046f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.015729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.016327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.016604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.016915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.017564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.019709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.034024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1073/2148] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:28.037341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.050637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96d55-0923-4e58-b8cf-450f311fe734 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.055492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.056157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.056438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.056694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] PATH_INFO: `/v3/projects/3343297ccea140ee98add7d8fb189f6f/users/e5e809aa87e74f1a80bab64c200fb444/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.072683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3343297ccea140ee98add7d8fb189f6f, user_id=e5e809aa87e74f1a80bab64c200fb444, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.075992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.198243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1076/2149] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:28 2022] PUT /identity/v3/projects/3343297ccea140ee98add7d8fb189f6f/users/e5e809aa87e74f1a80bab64c200fb444/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:28.202165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.215545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f2e36-67c7-48d1-8ad5-6a27cf82dae5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.285359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.286249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.286718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.286986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.287633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.289445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1f56f-9dea-486f-990d-250aa4613359 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.303330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1074/2150] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:28.304588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.315492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a506a27-0dc1-428b-ac5c-78a2057c59ad admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.320302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.320995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.321270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.321538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] PATH_INFO: `/v3/projects/3343297ccea140ee98add7d8fb189f6f/users/e5e809aa87e74f1a80bab64c200fb444/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.323712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3343297ccea140ee98add7d8fb189f6f, user_id=e5e809aa87e74f1a80bab64c200fb444, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.326675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.339031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1077/2151] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:28 2022] PUT /identity/v3/projects/3343297ccea140ee98add7d8fb189f6f/users/e5e809aa87e74f1a80bab64c200fb444/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:28.351357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.351716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.352072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.384743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] MFA Rules not processed for user `e5e809aa87e74f1a80bab64c200fb444`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:28.385982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:28.466966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1075/2152] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:28.479820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.481491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:28.553210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae9e3-5aaa-4d12-ab32-137cfd4dcb87 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.557862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.558800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.559207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.559496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.570267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.573464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.584013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1078/2153] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:28.808549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:28.819440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea6b8-c5e0-4ab8-9bc0-29ca10df37da None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:28.823108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:28.823705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:28.823980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:28.824256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:28.904581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:28.906502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46292341-f204-4f7a-bd4c-1f8a1cf625c4 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:28.930749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1076/2154] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:29.227176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:29.228877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:29.307414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d931d3-bc4a-479d-99ae-0b1c0da93a61 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:29.312796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:29.313495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:29.313826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:29.314098 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] PATH_INFO: `/v3/users/5c3db6eaba554be498e3cc83a240ac56` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:29.315360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3db6eaba554be498e3cc83a240ac56)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:29.317470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:29.763279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3db6eaba554be498e3cc83a240ac56'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:29.767960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3db6eaba554be498e3cc83a240ac56'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:29.767960 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3db6eaba554be498e3cc83a240ac56'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:29.959584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3db6eaba554be498e3cc83a240ac56'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:29.970668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3db6eaba554be498e3cc83a240ac56'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:30.002134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1079/2155] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:29 2022] DELETE /identity/v3/users/5c3db6eaba554be498e3cc83a240ac56 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:30.008932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:30.010063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:30.042448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:30.042448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:30.042448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:30.117571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1077/2156] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:30.134050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:30.135583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:30.212220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc39c-faa9-46e6-b970-79dd674aada9 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:30.218367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:30.219356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:30.219807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:30.220431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:30.240238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:30.242138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:30.259297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1080/2157] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:31.344297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:31.346105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:31.375375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02a473-a25f-4618-b423-62a9335d3877 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:31.433405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:31.434336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:31.434621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:31.434903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] PATH_INFO: `/v3/projects/193b121d5d2944f3898cb120e7f2107c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:31.439367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=193b121d5d2944f3898cb120e7f2107c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:31.442431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:31.726887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '193b121d5d2944f3898cb120e7f2107c', 'request_id': 'req-010cec2f-d268-4230-b816-18286aaaf794'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:31.787996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:31.850773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '193b121d5d2944f3898cb120e7f2107c', 'request_id': 'req-010cec2f-d268-4230-b816-18286aaaf794'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:31.861197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '193b121d5d2944f3898cb120e7f2107c', 'request_id': 'req-010cec2f-d268-4230-b816-18286aaaf794'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:31.880529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] The token cache is being invalidate because project 193b121d5d2944f3898cb120e7f2107c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:31.880856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:31.881543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:31.883521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1078/2158] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:31 2022] DELETE /identity/v3/projects/193b121d5d2944f3898cb120e7f2107c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:31.887323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:31.898955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a9d1c-4b54-4d1c-8d8e-e5ef61c1f5ee service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:31.966075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:31.967111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:31.967568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:31.969723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] PATH_INFO: `/v3/users/20450361e40045f9ac40c646f8150951` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:31.971830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20450361e40045f9ac40c646f8150951)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:31.975356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:32.415302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20450361e40045f9ac40c646f8150951'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:32.415999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20450361e40045f9ac40c646f8150951'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:32.416626 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20450361e40045f9ac40c646f8150951'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:32.552804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20450361e40045f9ac40c646f8150951'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:32.560193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9aa08991-8000-4609-8836-4f21d26794e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20450361e40045f9ac40c646f8150951'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:32.577634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1081/2159] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:31 2022] DELETE /identity/v3/users/20450361e40045f9ac40c646f8150951 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:33.000169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:33.419993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:33.421874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:33.435784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cec2f-d268-4230-b816-18286aaaf794 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:33.509472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:33.510123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:33.510405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:33.511447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] PATH_INFO: `/v3/projects/21f799a0418f43a793b37a41fee76c1c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:33.512564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f799a0418f43a793b37a41fee76c1c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:33.514585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:33.718528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f799a0418f43a793b37a41fee76c1c', 'request_id': 'req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:33.881863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f799a0418f43a793b37a41fee76c1c', 'request_id': 'req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:33.906258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f799a0418f43a793b37a41fee76c1c', 'request_id': 'req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:33.959727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] The token cache is being invalidate because project 21f799a0418f43a793b37a41fee76c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:33.960263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:33.961200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ca296a5d-c92b-4cb8-89c6-8f239f39d5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:33.964213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1079/2160] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:33 2022] DELETE /identity/v3/projects/21f799a0418f43a793b37a41fee76c1c => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:33.969217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:33.969853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:33.969853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.006166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:34.007434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:34.135522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1082/2161] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:34.142430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.142941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.143034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.177336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:34.178489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:34.189150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1080/2162] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:34.191004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.201434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976751d-f6ff-4831-ad59-fb81d21d89a8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.208309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.212617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:34.231784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1083/2163] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:34.233723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.245669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947cd1a6-afb6-4846-a45a-5dc9f56d9bf0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.255098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.255963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.256078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.256355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.256964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.259686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:34.488186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1081/2164] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:34 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:34.493656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.504725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f574fbc-8ee0-4446-9eb5-3c47c772b474 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.598783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.599198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.599489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.599766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.600413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.604197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:34.757243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1084/2165] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:34 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:34.759875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.773992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a23df2-59a2-41da-81ea-4bc8eb14e958 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.789019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.789958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.790473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.790924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.791781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.794007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:34.833334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1082/2166] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:34.834197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.841006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957e27d-0780-4a9f-92fb-a0c87c4c7e1b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.845990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.846773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.847082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.847456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.848402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.850221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f56ec5a-ce31-4c35-a556-5f13d955ed90 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:34.862234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1085/2167] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:34.867245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:34.879172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27230e9d-5ad2-4191-b79e-d864f6ae4625 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:34.884298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:34.884994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:34.885330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:34.885607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] PATH_INFO: `/v3/projects/0836522660fe4a92867470d9f5221949/users/e685ede40ae743ecbbe7150f50878a78/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:34.908373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0836522660fe4a92867470d9f5221949, user_id=e685ede40ae743ecbbe7150f50878a78, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:34.911470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:35.096762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1083/2168] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:34 2022] PUT /identity/v3/projects/0836522660fe4a92867470d9f5221949/users/e685ede40ae743ecbbe7150f50878a78/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:35.108090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:35.109002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:35.109002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:35.140334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] MFA Rules not processed for user `e685ede40ae743ecbbe7150f50878a78`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:35.141816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:35.310469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1086/2169] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:35.315479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:35.420160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fbec1-1828-414b-a8d0-0ec8d5037741 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:35.426342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:35.427094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:35.436044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:35.436044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:35.436044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:35.436044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:35.695624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1084/2170] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:35 2022] POST /identity/v3/projects => generated 383 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:35.697335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:35.718221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe30ad-ee4d-460c-af32-4fdb2173dd65 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:35.818353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:35.818353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:35.818353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:35.818353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:35.818903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:35.824577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.083292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1087/2171] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:35 2022] POST /identity/v3/users => generated 298 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:36.084706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.096646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a56520-1741-4f0d-addf-3bafc2eacf2c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.102673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.103704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.104117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.104495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.105341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.107828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.122837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1085/2172] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:36.126495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.141005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5584-681b-4ede-8071-2dacc1586814 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.162763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.164391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.164391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.164391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] PATH_INFO: `/v3/projects/37938c892d844821885336738a208706/users/a98691bdd7a641c287cd1c7b8c1aca4b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.178330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.180254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.202658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadab05e-e47c-43ab-8150-ec0a90774aef admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.203700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37938c892d844821885336738a208706, user_id=a98691bdd7a641c287cd1c7b8c1aca4b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.206835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.214917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.221011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.221397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.221785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] PATH_INFO: `/v3/users/298a95bbcd164d3e8f52943a91406515` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.224152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298a95bbcd164d3e8f52943a91406515)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.226408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.402135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1088/2173] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:36 2022] PUT /identity/v3/projects/37938c892d844821885336738a208706/users/a98691bdd7a641c287cd1c7b8c1aca4b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:36.407904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.408749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:36.492117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc54d2-d3e3-4d5e-92c6-6eb07e81c867 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.497670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.498517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.498801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.499070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.499727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.502113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.520052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1089/2174] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:36.526037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.541698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636f02-c8bb-4e0d-b6ac-eabde38349ee admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.547326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.548514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.549087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.549561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] PATH_INFO: `/v3/projects/37938c892d844821885336738a208706/users/a98691bdd7a641c287cd1c7b8c1aca4b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.552374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37938c892d844821885336738a208706, user_id=a98691bdd7a641c287cd1c7b8c1aca4b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.555539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1219eda-8368-4909-acf4-52367848d398 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:36.585313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298a95bbcd164d3e8f52943a91406515'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:36.586367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298a95bbcd164d3e8f52943a91406515'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:36.587237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298a95bbcd164d3e8f52943a91406515'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:36.594165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1090/2175] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:36 2022] PUT /identity/v3/projects/37938c892d844821885336738a208706/users/a98691bdd7a641c287cd1c7b8c1aca4b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:36.605731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b916e4-a571-433e-a2b1-50c4b9d5d4a1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.606055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b916e4-a571-433e-a2b1-50c4b9d5d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.606159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298a95bbcd164d3e8f52943a91406515'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:36.606268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b916e4-a571-433e-a2b1-50c4b9d5d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.633026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298a95bbcd164d3e8f52943a91406515'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:36.645323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-75b916e4-a571-433e-a2b1-50c4b9d5d4a1 None None] MFA Rules not processed for user `a98691bdd7a641c287cd1c7b8c1aca4b`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:36.646798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-75b916e4-a571-433e-a2b1-50c4b9d5d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.719014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1091/2176] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:36.720274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed2af-7b81-4fe6-9482-f5568aec331e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.720606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed2af-7b81-4fe6-9482-f5568aec331e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.720914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed2af-7b81-4fe6-9482-f5568aec331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.748840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:36.768424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3afed2af-7b81-4fe6-9482-f5568aec331e None None] MFA Rules not processed for user `3e79e8dbf9b24efcbfbd2c1e6f47e5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:36.770924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3afed2af-7b81-4fe6-9482-f5568aec331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.847583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1086/2177] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:36 2022] DELETE /identity/v3/users/298a95bbcd164d3e8f52943a91406515 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:36.849358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.851930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.855196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1092/2178] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:36.856773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.857062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.857339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.887464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:36.889194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.927271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a51fa-8041-466d-8514-96c3dfd13c65 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.931096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.931560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.932003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.932284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.959828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1093/2179] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:36.965379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:36.967988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:36.983263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593282a9-2965-4629-9860-417e1bd3f1b5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:36.989566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:36.990505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:36.990791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:36.991067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:36.991714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:36.999140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.015335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.017385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.029187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1087/2180] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:37.030350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.031882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:37.139592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611973e-bfad-4d64-bdd5-2b4778b497ce service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.155017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.155692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.155972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.156245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.167929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.169788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.183788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1088/2181] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:37.237150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1094/2182] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:36 2022] POST /identity/v3/projects => generated 381 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:37.239806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.251258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fd895-4c0e-4816-ab22-34de1c206987 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.324687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.328537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.328537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.328537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.328537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.329378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.345069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.347625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:37.442126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb87d4-b4f0-4c0c-9616-bfd1bb858e69 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.446139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.479016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.479016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.479016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.479016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:37.509335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.510790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.525048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1095/2183] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:37.563968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1089/2184] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:37 2022] POST /identity/v3/users => generated 297 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:37.568475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.582988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152e24b-8bcb-4e1e-b8c7-b32eed95314b service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.599705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.600340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.600618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.600933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.602066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.604985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.628746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1096/2185] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:37.629357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.644138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e43a54-f5d1-4f52-81f5-81626dd7cb6d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.649755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.650590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.650867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.651137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] PATH_INFO: `/v3/projects/a232e9c171614c6f95f494271dfff84b/users/f09c890abd954d0d8d27f389ab5c3a9e/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.669667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a232e9c171614c6f95f494271dfff84b, user_id=f09c890abd954d0d8d27f389ab5c3a9e, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.672553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.823286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1090/2186] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:37 2022] PUT /identity/v3/projects/a232e9c171614c6f95f494271dfff84b/users/f09c890abd954d0d8d27f389ab5c3a9e/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:37.846616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.858037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b5049-3a5e-4008-9271-df75c5d92269 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.918507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.919229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.919510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.919784 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.920430 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.922101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.932852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1097/2187] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:37.937190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:37.948429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c032e0f-29fb-4df4-9f37-3c14031f8e4c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:37.953186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:37.953915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:37.954268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:37.954626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] PATH_INFO: `/v3/projects/a232e9c171614c6f95f494271dfff84b/users/f09c890abd954d0d8d27f389ab5c3a9e/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:37.957243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a232e9c171614c6f95f494271dfff84b, user_id=f09c890abd954d0d8d27f389ab5c3a9e, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:37.960109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:37.970696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1091/2188] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:37 2022] PUT /identity/v3/projects/a232e9c171614c6f95f494271dfff84b/users/f09c890abd954d0d8d27f389ab5c3a9e/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:38.030020 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:38.032385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:38.068816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589ce5ad-add9-4f3d-a296-41309397efb8 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:38.162796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:38.163461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:38.167958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:38.167958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] PATH_INFO: `/v3/projects/679d8ea6e8524e2db93914ca3397fe86` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:38.168209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=679d8ea6e8524e2db93914ca3397fe86)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:38.175204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:38.298708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:38.301359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:38.316954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab55943-8c07-4fa1-9763-1749e0b3cfa4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:38.323682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:38.324574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:38.324926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:38.325211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] PATH_INFO: `/v3/users/10a5da0f860d40b88f74018ef03d8804` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:38.326426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a5da0f860d40b88f74018ef03d8804)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:38.328648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:38.366131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '679d8ea6e8524e2db93914ca3397fe86', 'request_id': 'req-abd4ff09-2796-408a-bf47-b823a1d41c8b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.378696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '679d8ea6e8524e2db93914ca3397fe86', 'request_id': 'req-abd4ff09-2796-408a-bf47-b823a1d41c8b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.399300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '679d8ea6e8524e2db93914ca3397fe86', 'request_id': 'req-abd4ff09-2796-408a-bf47-b823a1d41c8b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.572458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] The token cache is being invalidate because project 679d8ea6e8524e2db93914ca3397fe86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:38.572846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.573561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.576528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1098/2189] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:38 2022] DELETE /identity/v3/projects/679d8ea6e8524e2db93914ca3397fe86 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:38.580107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:38.583440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:38.628093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a5da0f860d40b88f74018ef03d8804'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.629591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a5da0f860d40b88f74018ef03d8804'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.630231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a5da0f860d40b88f74018ef03d8804'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.638808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a5da0f860d40b88f74018ef03d8804'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.657722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-448bcf4c-78e7-49fa-accd-8c368db98c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a5da0f860d40b88f74018ef03d8804'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:38.754107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4ff09-2796-408a-bf47-b823a1d41c8b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:38.758997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:38.759711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:38.760176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:38.760551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] PATH_INFO: `/v3/users/aa6b580050ba44f8920e677b46a11032` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:38.761957 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6b580050ba44f8920e677b46a11032)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:38.763978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:38.811370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1092/2190] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:38 2022] DELETE /identity/v3/users/10a5da0f860d40b88f74018ef03d8804 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:38.815940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:38.816166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:38.817008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:38.837398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:38.838363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:38.898590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1093/2191] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:38.908121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:38.909659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:39.035353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd4346-4636-4aeb-a3b8-17070b9578c2 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:39.056705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:39.057385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:39.057664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:39.057934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:39.087602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:39.090127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:39.117977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1094/2192] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:39.118875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:39.123605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:39.158279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51514a-e876-4cd7-aca6-2c6cd3f5ef50 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:39.165047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:39.165903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:39.166328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:39.166815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] PATH_INFO: `/v3/users/e685ede40ae743ecbbe7150f50878a78` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:39.168546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e685ede40ae743ecbbe7150f50878a78)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:39.170702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:39.234406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6b580050ba44f8920e677b46a11032'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.235132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6b580050ba44f8920e677b46a11032'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.235772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6b580050ba44f8920e677b46a11032'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.428842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6b580050ba44f8920e677b46a11032'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.451569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-251360ba-12af-4234-84d2-2a065ae4d64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6b580050ba44f8920e677b46a11032'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.471671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1099/2193] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:38 2022] DELETE /identity/v3/users/aa6b580050ba44f8920e677b46a11032 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:39.718082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e685ede40ae743ecbbe7150f50878a78'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.719797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e685ede40ae743ecbbe7150f50878a78'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.720667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e685ede40ae743ecbbe7150f50878a78'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.731413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e685ede40ae743ecbbe7150f50878a78'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.761479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e685ede40ae743ecbbe7150f50878a78'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:39.886184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1095/2194] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:39 2022] DELETE /identity/v3/users/e685ede40ae743ecbbe7150f50878a78 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:39.891113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:39.891422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:39.891908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:39.924903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:39.930030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:40.041811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1100/2195] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:40.055494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:40.057072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:40.126978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9df697-f2af-4478-9d43-56f0d1a4d4a9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:40.132453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:40.133198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:40.133507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:40.133784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:40.144209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:40.145839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:40.163338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1096/2196] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:40.204237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:40.205725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:40.228478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bebd8-feef-4944-802d-fd14dec5fcb3 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:40.242797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:40.252868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:40.252868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:40.252868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] PATH_INFO: `/v3/projects/f60cf30b8d374789ae187df36c4bea81` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:40.252868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f60cf30b8d374789ae187df36c4bea81)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:40.252868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:40.498185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f60cf30b8d374789ae187df36c4bea81', 'request_id': 'req-074b4ae7-fd9b-4e58-b784-288c1fb7e103'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:40.505304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f60cf30b8d374789ae187df36c4bea81', 'request_id': 'req-074b4ae7-fd9b-4e58-b784-288c1fb7e103'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:40.511641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f60cf30b8d374789ae187df36c4bea81', 'request_id': 'req-074b4ae7-fd9b-4e58-b784-288c1fb7e103'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:40.645119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] The token cache is being invalidate because project f60cf30b8d374789ae187df36c4bea81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:40.645561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:40.650633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:40.653684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1101/2197] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:40 2022] DELETE /identity/v3/projects/f60cf30b8d374789ae187df36c4bea81 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:40.657720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:40.676147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ab661-ea0e-4cf6-8b63-c90708765304 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:40.712194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:40.713949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:40.832573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b4ae7-fd9b-4e58-b784-288c1fb7e103 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:40.839717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:40.842410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:40.842821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:40.844647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:40.845840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:40.846294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:40.846740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] PATH_INFO: `/v3/users/e5e809aa87e74f1a80bab64c200fb444` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:40.849386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5e809aa87e74f1a80bab64c200fb444)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:40.851654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:40.858961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] PATH_INFO: `/v3/projects/78cca9e8264d4201804246dd0d893ca2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:40.861535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78cca9e8264d4201804246dd0d893ca2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:40.866681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:41.246294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78cca9e8264d4201804246dd0d893ca2', 'request_id': 'req-849f895e-a562-4b06-9ae3-36600a8bba2e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.254596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78cca9e8264d4201804246dd0d893ca2', 'request_id': 'req-849f895e-a562-4b06-9ae3-36600a8bba2e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.262215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78cca9e8264d4201804246dd0d893ca2', 'request_id': 'req-849f895e-a562-4b06-9ae3-36600a8bba2e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.348916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] The token cache is being invalidate because project 78cca9e8264d4201804246dd0d893ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:41.349539 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.351614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.365451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1102/2198] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:40 2022] DELETE /identity/v3/projects/78cca9e8264d4201804246dd0d893ca2 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:41.366939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:41.386151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5e809aa87e74f1a80bab64c200fb444'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.386151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5e809aa87e74f1a80bab64c200fb444'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.386151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5e809aa87e74f1a80bab64c200fb444'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.387509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5e809aa87e74f1a80bab64c200fb444'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.389723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:41.404011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b0c6a4-0721-44ce-9237-ff9c38fb2624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5e809aa87e74f1a80bab64c200fb444'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.535864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1097/2199] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:40 2022] DELETE /identity/v3/users/e5e809aa87e74f1a80bab64c200fb444 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:41.535864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8a9b-48f8-47d1-927c-9bd6df03cf7a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:41.535864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8a9b-48f8-47d1-927c-9bd6df03cf7a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:41.536252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856c8a9b-48f8-47d1-927c-9bd6df03cf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:41.538987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f895e-a562-4b06-9ae3-36600a8bba2e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:41.587252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-856c8a9b-48f8-47d1-927c-9bd6df03cf7a None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:41.589888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-856c8a9b-48f8-47d1-927c-9bd6df03cf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:41.640166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:41.640926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:41.641413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:41.641700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] PATH_INFO: `/v3/projects/0836522660fe4a92867470d9f5221949` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:41.643011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0836522660fe4a92867470d9f5221949)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:41.647329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:41.716999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1098/2200] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:41.726441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:41.731552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:41.731552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:41.754291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:41.755657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:41.773380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1099/2201] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:41.778596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:41.789718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab76bb4-2033-4f95-995b-b5fabd174e8b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:41.795012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:41.795734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:41.796012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:41.796419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:41.797814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:41.798279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:41.800274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:41.803492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:41.821493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1100/2202] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:57:41.825874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:41.837877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec411-4861-42d3-9cec-840bc91a6594 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:41.843119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:41.843747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:41.844023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:41.844292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:41.858456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:41.858456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:41.886226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0836522660fe4a92867470d9f5221949', 'request_id': 'req-97603a5e-ff8b-498f-841b-22104cbc6d98'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.917360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0836522660fe4a92867470d9f5221949', 'request_id': 'req-97603a5e-ff8b-498f-841b-22104cbc6d98'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.935030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0836522660fe4a92867470d9f5221949', 'request_id': 'req-97603a5e-ff8b-498f-841b-22104cbc6d98'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:41.999656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1101/2203] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:41 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:42.005089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:42.144391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae49177-ad3b-454e-a684-72d0852bc721 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:42.149630 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:42.150247 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:42.150523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:42.151619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:42.152272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:42.155478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:42.219696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] The token cache is being invalidate because project 0836522660fe4a92867470d9f5221949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:42.230645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.230645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.230645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1103/2204] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:41 2022] DELETE /identity/v3/projects/0836522660fe4a92867470d9f5221949 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:42.233607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:42.234817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:42.311971 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97603a5e-ff8b-498f-841b-22104cbc6d98 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:42.315425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:42.316254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:42.316686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:42.317171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] PATH_INFO: `/v3/users/a98691bdd7a641c287cd1c7b8c1aca4b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:42.318834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a98691bdd7a641c287cd1c7b8c1aca4b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:42.321047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:42.348836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1102/2205] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:42 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:42.349768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:42.356619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:42.383096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd0796-7190-43ef-b892-483214eeb748 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:42.388620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:42.389537 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:42.389968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:42.390458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] PATH_INFO: `/v3/projects/3343297ccea140ee98add7d8fb189f6f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:42.391831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3343297ccea140ee98add7d8fb189f6f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:42.394988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:42.668931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a98691bdd7a641c287cd1c7b8c1aca4b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.669751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a98691bdd7a641c287cd1c7b8c1aca4b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.669844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3343297ccea140ee98add7d8fb189f6f', 'request_id': 'req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.670392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a98691bdd7a641c287cd1c7b8c1aca4b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.798610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3343297ccea140ee98add7d8fb189f6f', 'request_id': 'req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.808324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3343297ccea140ee98add7d8fb189f6f', 'request_id': 'req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.826363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] The token cache is being invalidate because project 3343297ccea140ee98add7d8fb189f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:42.826655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.827326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.832778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1103/2206] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:42 2022] DELETE /identity/v3/projects/3343297ccea140ee98add7d8fb189f6f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:42.832778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:42.832778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:42.920528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4392d-ea63-48f7-9f9f-cb1b9eb65b0d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:42.930037 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:42.930825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:42.931171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:42.931513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:42.934400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:42.934400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d923dd9-bf9d-4e00-a19b-378fb8f267b1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:42.968604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1104/2207] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:42.970010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09991-a8a9-4b0e-8b6e-d9093cee8be9 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:42.970438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09991-a8a9-4b0e-8b6e-d9093cee8be9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:42.970612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d09991-a8a9-4b0e-8b6e-d9093cee8be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:42.989232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a98691bdd7a641c287cd1c7b8c1aca4b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:42.997860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a98691bdd7a641c287cd1c7b8c1aca4b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:43.031690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-51d09991-a8a9-4b0e-8b6e-d9093cee8be9 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:43.033066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-51d09991-a8a9-4b0e-8b6e-d9093cee8be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:43.038922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1104/2208] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:42 2022] DELETE /identity/v3/users/a98691bdd7a641c287cd1c7b8c1aca4b => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:43.039975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.055915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:43.228979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491822-b81b-4afb-8250-4d0f0bebc834 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:43.238829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:43.240432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.242838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.244433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.247934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:43.250603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:43.287160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1105/2209] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:43.289786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1105/2210] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:43.290895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.291652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.291948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.292365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.321333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc87e-04db-4639-b019-64d4a95ec35f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:43.327356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:43.328507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.329044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.329476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] PATH_INFO: `/v3/projects/dc470b8044ed45a486efe79ec5854683/users/c9ce75f6844d4d8397552b5b02407e30/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.347697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:43.354538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:43.355799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc470b8044ed45a486efe79ec5854683, user_id=c9ce75f6844d4d8397552b5b02407e30, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:43.359061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673f6d-313b-4f77-b687-776577e592b2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:43.376348 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1106/2211] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:43.381460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.397180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d07c9-3b3c-4d1f-b07a-ac5f166a9efd None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:43.402783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:43.411649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:43.421795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1107/2212] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:57:43.427140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.439627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1068-9a35-4614-89aa-e662090653ab admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:43.447134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:43.448035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.448417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.448701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.449422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:43.451486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:43.611322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1106/2213] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:43 2022] PUT /identity/v3/projects/dc470b8044ed45a486efe79ec5854683/users/c9ce75f6844d4d8397552b5b02407e30/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:43.624315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.624595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.624907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.684690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] MFA Rules not processed for user `c9ce75f6844d4d8397552b5b02407e30`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:43.687232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:43.775906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1108/2214] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:43 2022] POST /identity/v3/projects => generated 379 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:43.777288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.887929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bccacd1-aa32-4c33-b460-f47872eb1142 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:43.890994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1107/2215] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:43.894711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:43.895466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:43.895821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:43.896164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:43.897231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:43.899463 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:43.900232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:43.901770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:43.990944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829c1d8-4ad5-4a0f-bd92-bb3643da647d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.054696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.055308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.055585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.055860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.110730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1109/2216] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:43 2022] POST /identity/v3/users => generated 290 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:44.114554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:44.131554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a08db-1f97-4e48-8cf7-19503d8626ea admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.137564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.138305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.139180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.139566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.140495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.142566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.156510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.158422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.162614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1110/2217] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:44.163979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:44.177495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1108/2218] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:44.192781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd6034-b830-40a2-b4f1-a0bd66a5cb54 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.198492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.199209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.199554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.199939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.200817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.215617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.248056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1111/2219] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:44.249205 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:44.265807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f447f-f9bd-4223-a995-cb271f08898e service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.275767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.276512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.276920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.277289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] PATH_INFO: `/v3/projects/b80b661a79aa414cb8c59e2301c6c158/users/18e2d5f553614a19a356ae4a4ea4a0b9/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.302884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80b661a79aa414cb8c59e2301c6c158, user_id=18e2d5f553614a19a356ae4a4ea4a0b9, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.306576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d06a6-9d09-4e6f-b571-432bd2657bdd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.366534 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:44.368795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:44.390009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a79c1-b990-465c-b22f-02cf5b77417c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.410939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.411716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.412565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.412945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] PATH_INFO: `/v3/projects/37938c892d844821885336738a208706` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.415793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] RBAC: Authorizing `identity:delete_project(project_id=37938c892d844821885336738a208706)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.418466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.531708 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1109/2220] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:44 2022] PUT /identity/v3/projects/b80b661a79aa414cb8c59e2301c6c158/users/18e2d5f553614a19a356ae4a4ea4a0b9/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:44.554331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.554968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.556609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.621617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] MFA Rules not processed for user `18e2d5f553614a19a356ae4a4ea4a0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:44.623062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:44.729253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1110/2221] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:44.732843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:44.749549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:44.768183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37938c892d844821885336738a208706', 'request_id': 'req-a83880fb-0d80-4943-8a3d-cc805d89908e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:44.845227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81361d77-abc5-443c-a287-4bfd9aa84eef None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:44.904954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37938c892d844821885336738a208706', 'request_id': 'req-a83880fb-0d80-4943-8a3d-cc805d89908e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:44.920411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37938c892d844821885336738a208706', 'request_id': 'req-a83880fb-0d80-4943-8a3d-cc805d89908e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:44.957346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:44.957346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.957346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.957346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:44.957976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:44.957976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:44.959109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] The token cache is being invalidate because project 37938c892d844821885336738a208706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:57:44.961430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:44.963005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a83880fb-0d80-4943-8a3d-cc805d89908e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:44.966291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1112/2222] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:57:44 2022] DELETE /identity/v3/projects/37938c892d844821885336738a208706 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:44.974196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2442c-049a-4d15-a466-72afee178260 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:44.974556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2442c-049a-4d15-a466-72afee178260 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:44.979948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2442c-049a-4d15-a466-72afee178260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.003577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4fa2442c-049a-4d15-a466-72afee178260 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:45.008876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4fa2442c-049a-4d15-a466-72afee178260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:45.019717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1113/2223] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:45.030783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.031117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.031655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.054250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:45.055477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:45.064132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1114/2224] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:45.069143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.078509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dfd71-3339-4a1f-bb6f-5c2041232718 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.085046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.085839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.089019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.089019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.089019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:57:45.089019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.089324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.106020 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1115/2225] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:57:45.109474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.125462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf445-1afd-4511-a557-e50f14afb0d0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.131379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.132082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.132426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.132797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.133587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.135577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.202168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1111/2226] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:44 2022] POST /identity/v3/projects => generated 377 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:45.204096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.213928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:45.330733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7392-66e4-4b5e-83cf-bdcb8de071dd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.338990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.339748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.340158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.340532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.341313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.343536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.361329 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1116/2227] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:45 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:45.362919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.441228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f53546-3277-490c-a8e3-ed4b31a68188 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.449929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.450669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.451008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.451339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.458163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.458163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.497577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1112/2228] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:45 2022] POST /identity/v3/users => generated 295 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:45.501797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.513827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ed4c8-8299-4da5-a779-f6976a545d17 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.527215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.527215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.527215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.527215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.527693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.527693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.535872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1113/2229] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:57:45.540284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.551685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b71a-23e9-43c8-b827-fe7ba0ec14a8 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.556555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.557311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.557590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.557864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] PATH_INFO: `/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3/users/d2fd1f9787dc453098146332baa16d17/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.575522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3f4f88a95347d8b7ae6d8cb38294d3, user_id=d2fd1f9787dc453098146332baa16d17, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.578441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.582367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1117/2230] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:45 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:45.586838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.599108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3353c-af81-4692-b216-2c923c058098 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.603863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.604435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.604742 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.605099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.606283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.608033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.622356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1118/2231] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:45.623600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.635813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cdeec-d5ea-4922-a71d-d5699033a8c4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.641073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.642221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.642499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.642798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.643484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.645450 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.661865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1119/2232] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:45.663422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.674785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56726a07-965d-4bdf-9b15-e82ccaa6a5ff admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.687222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.689353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.689353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.689353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] PATH_INFO: `/v3/projects/92ec24068d3c4a3a8290825e6c398cf5/users/1e4c2462eb12418884fd306ffbca2893/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.717339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ec24068d3c4a3a8290825e6c398cf5, user_id=1e4c2462eb12418884fd306ffbca2893, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.721849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261caf22-d70a-4325-8baa-6dee6d062cad admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.731439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1114/2233] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:45 2022] PUT /identity/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3/users/d2fd1f9787dc453098146332baa16d17/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:57:45.735703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.883821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e830c9-e46c-4415-a802-fceb32ff9a7f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:45.893133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:45.894689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.895046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.895390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.896395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:45.905336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:45.923676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1120/2234] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:45 2022] PUT /identity/v3/projects/92ec24068d3c4a3a8290825e6c398cf5/users/1e4c2462eb12418884fd306ffbca2893/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:45.936806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109642-3c25-422b-8448-62439724b474 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:45.937129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109642-3c25-422b-8448-62439724b474 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:45.937472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d109642-3c25-422b-8448-62439724b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:45.943158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1115/2235] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:45.944308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:45.955486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a267c4b-d160-44fb-95be-704e40fb1b82 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:46.019558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5d109642-3c25-422b-8448-62439724b474 None None] MFA Rules not processed for user `1e4c2462eb12418884fd306ffbca2893`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:46.023368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5d109642-3c25-422b-8448-62439724b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:46.077607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:46.078751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.079305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.079700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] PATH_INFO: `/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3/users/d2fd1f9787dc453098146332baa16d17/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.083514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3f4f88a95347d8b7ae6d8cb38294d3, user_id=d2fd1f9787dc453098146332baa16d17, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:46.087294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563ac6a-eeb4-44ed-85ee-be12099dba3f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:46.104692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1116/2236] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:45 2022] PUT /identity/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3/users/d2fd1f9787dc453098146332baa16d17/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:46.124822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.124822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.124822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.167137 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] MFA Rules not processed for user `d2fd1f9787dc453098146332baa16d17`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:46.168667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1121/2237] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:46.170930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:46.178189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109642-3c25-422b-8448-62439724b474 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:46.202049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d109642-3c25-422b-8448-62439724b474 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:46.305930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1117/2238] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:46.306119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:46.308103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.308387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.308659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.309638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:46.312892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:46.317733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:46.319565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:46.405499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d0700-ac2b-4753-ac7f-789ea383a217 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:46.413812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:46.413812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.413812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.413812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.416269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:46.500171 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:46.503955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1122/2239] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:57:46 2022] POST /identity/v3/projects => generated 385 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:57:46.507054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:46.508129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:46.526517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1118/2240] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:46.609979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aacdf8-3df5-4143-85f8-2b7dfb3546e8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:46.618797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:46.620442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.620840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.621195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.622069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:46.624651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:46.918800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1123/2241] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:57:46 2022] POST /identity/v3/users => generated 299 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:57:46.919494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:46.933875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abcae71-8653-427c-bd4f-a3367f22ef6c service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:46.939438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:46.940476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:46.940575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:46.941389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:46.941690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:46.943323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:46.957131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1119/2242] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:46.971271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:47.001810 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21c5c5-d861-4f9c-a4b3-0182736c5c00 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:47.018243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:47.020888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:47.023667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:47.024241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] PATH_INFO: `/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd/users/11811d26e37440f6940d4604368fea76/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:47.057809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9923017a7bf48b88d7b9788d6ac54cd, user_id=11811d26e37440f6940d4604368fea76, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:47.062493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:47.192901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1124/2243] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:46 2022] PUT /identity/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd/users/11811d26e37440f6940d4604368fea76/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:47.197583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:47.222024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4daa4-f5e5-4ce5-b3c4-556192947809 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:47.350818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:47.351640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:47.351868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:47.352142 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:47.352827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:47.357037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b23b3c-e80f-4da0-b3f3-253ae0ec7f78 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:47.378320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1120/2244] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:57:47.383115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:47.405283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d87a05-5c20-44ba-ba41-2222a52b4929 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:47.413770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:47.414629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:47.414910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:47.415746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] PATH_INFO: `/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd/users/11811d26e37440f6940d4604368fea76/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:47.417280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9923017a7bf48b88d7b9788d6ac54cd, user_id=11811d26e37440f6940d4604368fea76, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:47.420381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:47.436733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1125/2245] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:57:47 2022] PUT /identity/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd/users/11811d26e37440f6940d4604368fea76/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:47.449548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad4dd-a595-4828-86a2-4a2fdb13a517 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:47.450034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad4dd-a595-4828-86a2-4a2fdb13a517 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:47.450408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ad4dd-a595-4828-86a2-4a2fdb13a517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:47.508533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0d8ad4dd-a595-4828-86a2-4a2fdb13a517 None None] MFA Rules not processed for user `11811d26e37440f6940d4604368fea76`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:47.509842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0d8ad4dd-a595-4828-86a2-4a2fdb13a517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:47.618238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1121/2246] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:47.773915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:47.806130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:47.807995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:47.905306 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ab8b-a232-4209-8401-a9403f801f68 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:47.949893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:47.949893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:47.949893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:47.949893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:48.071216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:48.073233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:48.088413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1126/2247] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:48.960359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30435aa-6b04-483e-ac09-2f5470fdbbc4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:48.960893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30435aa-6b04-483e-ac09-2f5470fdbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:48.962229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30435aa-6b04-483e-ac09-2f5470fdbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:49.031779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c30435aa-6b04-483e-ac09-2f5470fdbbc4 None None] MFA Rules not processed for user `f09c890abd954d0d8d27f389ab5c3a9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:49.033306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c30435aa-6b04-483e-ac09-2f5470fdbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:49.186486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1122/2248] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:49.202982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:49.207443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:49.378111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcdc6f-e298-4e5d-aea3-790d3ded4b1e service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:49.387892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:49.388583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:49.389082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:49.390971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:49.395394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:49.551253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:49.553271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:49.563758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1127/2249] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:50.040244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a27f-a739-4267-8728-73da3b459569 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:50.040686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a27f-a739-4267-8728-73da3b459569 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:50.040930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a27f-a739-4267-8728-73da3b459569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:50.070169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4900a27f-a739-4267-8728-73da3b459569 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:50.071979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4900a27f-a739-4267-8728-73da3b459569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:50.147734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1123/2250] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:57:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:50.208922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:50.210592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:50.312965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263f593-5ef3-40ab-841a-73015b14f5e3 service glance] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:50.322115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:50.322800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:50.323092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:50.323640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:50.334998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:50.338771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:50.354091 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1128/2251] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:57:50.579941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a27f-a739-4267-8728-73da3b459569 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:50.597768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a27f-a739-4267-8728-73da3b459569 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:50.614131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:50.615186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:50.616287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:50.616837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:50.837437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:50.839462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:50.874304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1124/2252] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:57:52.743411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:54.720760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:57.205059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:57.630004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:57.633377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:57.646967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb97059-f3b9-4f63-992d-ac68689a169b service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:57.654600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:57.655497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:57.655921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:57.656344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:57.669362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:57.670868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f57f5d-f17c-41e2-9e42-98e2651d8e5b service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:57.687379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1125/2253] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:57:57.785954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c9614-7c58-4a7d-9428-92716dc906a5 service swift] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:57.796232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:57.797557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:57.798059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:57.804173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] PATH_INFO: `/v3/users/18e2d5f553614a19a356ae4a4ea4a0b9` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:57.805879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e2d5f553614a19a356ae4a4ea4a0b9)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:57.813977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:57.816312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:57:58.165363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e2d5f553614a19a356ae4a4ea4a0b9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:58.166304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e2d5f553614a19a356ae4a4ea4a0b9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:58.166948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e2d5f553614a19a356ae4a4ea4a0b9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:58.176865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:58.176865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:58.176865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:58.179256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e2d5f553614a19a356ae4a4ea4a0b9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:58.196379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:58.197895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:58.198698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-42705442-9269-4e86-8026-9a695d47b0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e2d5f553614a19a356ae4a4ea4a0b9'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:57:58.221760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1126/2254] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:57:58.244979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:58.244979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:58.299043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef43f-3dba-4d27-bcfa-5f8814392759 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:58.311879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:58.312792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:58.313219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:58.313664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:58.334019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1129/2255] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:57:57 2022] DELETE /identity/v3/users/18e2d5f553614a19a356ae4a4ea4a0b9 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:57:58.348901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:58.349637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:58.352272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:58.353589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:58.354410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:58.383782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1127/2256] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:57:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:57:58.417140 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:57:58.419252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:58.567544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1130/2257] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:57:58.601807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:57:58.604893 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:57:58.715775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79226052-c8e8-43e7-8314-7ba119d1ce49 service swift] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:57:58.854756 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:57:58.855265 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:57:58.860191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:57:58.860478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:57:58.897133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:57:58.898829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:57:58.944312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1128/2258] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:00.364494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:00.366957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:00.409367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62444dec-d9fe-482a-b3d9-bd195510499b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:00.431708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:00.433983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:00.436543 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:00.437168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] PATH_INFO: `/v3/projects/b80b661a79aa414cb8c59e2301c6c158` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:00.442444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80b661a79aa414cb8c59e2301c6c158)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:00.449619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:00.773154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80b661a79aa414cb8c59e2301c6c158', 'request_id': 'req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:01.478587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80b661a79aa414cb8c59e2301c6c158', 'request_id': 'req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:01.486004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80b661a79aa414cb8c59e2301c6c158', 'request_id': 'req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:01.520448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] The token cache is being invalidate because project b80b661a79aa414cb8c59e2301c6c158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:01.520448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:01.520448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:01.523899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1131/2259] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:00 2022] DELETE /identity/v3/projects/b80b661a79aa414cb8c59e2301c6c158 => generated 0 bytes in 1162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:01.529557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:01.546397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0daa8-25d7-4fbd-972a-abafbdee5baa service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:01.732533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:01.733134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:01.733417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:01.733695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] PATH_INFO: `/v3/users/d2fd1f9787dc453098146332baa16d17` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:01.735081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2fd1f9787dc453098146332baa16d17)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:01.737981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:02.393550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2fd1f9787dc453098146332baa16d17'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:02.394323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2fd1f9787dc453098146332baa16d17'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:02.395118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2fd1f9787dc453098146332baa16d17'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:02.587457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2fd1f9787dc453098146332baa16d17'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:02.604084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2fd1f9787dc453098146332baa16d17'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:02.678620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1129/2260] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:01 2022] DELETE /identity/v3/users/d2fd1f9787dc453098146332baa16d17 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:03.600037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:03.805696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:03.807816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:03.849766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd5abc5-5bc2-446d-8236-7ac1b9d860c3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:04.041658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:04.042318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.042612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.042889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] PATH_INFO: `/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.048195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3f4f88a95347d8b7ae6d8cb38294d3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:04.057021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:04.385922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3f4f88a95347d8b7ae6d8cb38294d3', 'request_id': 'req-71c420f3-cd32-496e-b782-fc20b2bce6bd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:04.509917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3f4f88a95347d8b7ae6d8cb38294d3', 'request_id': 'req-71c420f3-cd32-496e-b782-fc20b2bce6bd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:04.524623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3f4f88a95347d8b7ae6d8cb38294d3', 'request_id': 'req-71c420f3-cd32-496e-b782-fc20b2bce6bd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:04.563015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:04.563933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:04.592833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adaf2-b9b3-475a-a8dd-c21c280e1dc5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:04.605065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] The token cache is being invalidate because project 9f3f4f88a95347d8b7ae6d8cb38294d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:04.606404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:04.608938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-71c420f3-cd32-496e-b782-fc20b2bce6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:04.618101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1132/2261] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:03 2022] DELETE /identity/v3/projects/9f3f4f88a95347d8b7ae6d8cb38294d3 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:04.619778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0099-13a2-4c37-bb28-c1dc389821bd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.619956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0099-13a2-4c37-bb28-c1dc389821bd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.620216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d0099-13a2-4c37-bb28-c1dc389821bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.668849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8b8d0099-13a2-4c37-bb28-c1dc389821bd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:04.671429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8b8d0099-13a2-4c37-bb28-c1dc389821bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:04.740768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:04.743281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.746147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.746730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] PATH_INFO: `/v3/users/c9ce75f6844d4d8397552b5b02407e30` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.755803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ce75f6844d4d8397552b5b02407e30)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:04.763829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:04.783921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1133/2262] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:04.793693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.793989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.794438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.821086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:04.823209 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:04.847771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1134/2263] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:04.852089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:04.865530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b30b4-f478-4173-9e51-b78d5bb63cf2 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:04.891005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:04.894467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.895835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.896960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.901528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:04.904163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:04.913661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:04.943175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1135/2264] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:58:04.949705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:04.975633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6953b97-0ed8-4bde-806d-298dedd54428 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:04.990129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:04.990358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:04.990623 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:04.990980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:04.991784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:05.000330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:05.139701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ce75f6844d4d8397552b5b02407e30'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:05.144657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ce75f6844d4d8397552b5b02407e30'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:05.147509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ce75f6844d4d8397552b5b02407e30'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:05.210475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1136/2265] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:04 2022] POST /identity/v3/projects => generated 379 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:05.216539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:05.221008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:05.272941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ce75f6844d4d8397552b5b02407e30'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:05.284152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3ba79aa4-6a28-467d-9759-380f4b7c90a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ce75f6844d4d8397552b5b02407e30'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:05.396568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1130/2266] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:04 2022] DELETE /identity/v3/users/c9ce75f6844d4d8397552b5b02407e30 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:05.400512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:05.402566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:05.403269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:05.452321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:05.514634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:05.523556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:05.582433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30115bc-5341-4cd2-9d42-c7d88e643070 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:05.887229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:05.888748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1131/2267] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:05.889645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:05.889645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:05.889645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:05.889645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:05.889645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:05.900799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:05.902290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:06.145703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1137/2268] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:05 2022] POST /identity/v3/users => generated 290 bytes in 927 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:06.146189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:06.179021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcb973-f11f-44ee-ae8f-667134c8e11d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:06.197293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:06.197710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:06.198005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:06.198380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:06.199150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:06.203584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:06.230622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1138/2269] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:58:06.241170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:06.258810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77936eb0-dca2-4d56-913d-a4f206d81420 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:06.272832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:06.276589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:06.276589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:06.276589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:06.276984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814db3b-82dd-47df-8dfb-803f56c02f7b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:06.289522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:06.290699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:06.294041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:06.294414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:06.295269 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:06.297316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:06.301536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c3ef3-ccca-4cfc-ae49-d20d22f78373 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:06.303619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:06.329707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1132/2270] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:58:06.398018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1139/2271] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:06.402562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:06.418870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51233c1-6a38-4be8-9b32-3b6f42a91210 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:06.434145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:06.436563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:06.436879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:06.437164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] PATH_INFO: `/v3/projects/cdac3a28c77d4194ba94831374942d86/users/d3f672b799a84886876b49c93181d6b1/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:06.482760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdac3a28c77d4194ba94831374942d86, user_id=d3f672b799a84886876b49c93181d6b1, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:06.494447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:06.646482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1133/2272] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:06 2022] PUT /identity/v3/projects/cdac3a28c77d4194ba94831374942d86/users/d3f672b799a84886876b49c93181d6b1/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:06.656927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:06.657191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:06.657367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:06.725421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] MFA Rules not processed for user `d3f672b799a84886876b49c93181d6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:06.727023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:06.980335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1140/2273] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:07.011382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:07.150339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923512e1-2b8d-4b66-a5f4-03146f95f62a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:07.156628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:07.157569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:07.157895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:07.158338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:07.161228 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:07.163954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:07.805869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1134/2274] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:07 2022] POST /identity/v3/projects => generated 377 bytes in 795 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:07.811729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:07.853633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465b50-4642-4206-b124-0f6c9767e401 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:08.008275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:08.009101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.009455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.009798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:08.010606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:08.024965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:08.324628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1141/2275] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:07 2022] POST /identity/v3/users => generated 289 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:08.332252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:08.334825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:08.338434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:08.370043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f5393-5a90-46d0-8dcb-80b200ab7d88 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:08.376553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16dcbba-66c0-4b86-9067-04db5fd498b9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:08.390928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:08.408101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:08.417078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.418838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.423032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] PATH_INFO: `/v3/projects/dc470b8044ed45a486efe79ec5854683` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:08.426912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc470b8044ed45a486efe79ec5854683)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:08.427889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:08.430820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:08.443375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.449935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.450393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:08.451289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:08.459979 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:08.481652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1142/2276] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:08.482852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:08.518137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e17cf-f746-40a0-bd91-1738e87878fa admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:08.532544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:08.533261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.533755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.534148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:08.534934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:08.538466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:08.567235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1143/2277] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:08.578337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:08.601270 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfd05c-161c-4ada-a4de-27af29294fda admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:08.609039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:08.613281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.613281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.613281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] PATH_INFO: `/v3/projects/16ffd675672740e9b5d6a8a31baf1bc5/users/89e8db16b7e24f49887780368aa746c0/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:08.672322 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ffd675672740e9b5d6a8a31baf1bc5, user_id=89e8db16b7e24f49887780368aa746c0, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:08.676164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a2a30-d443-414d-abeb-fc6d5c08ca93 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:08.988594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1144/2278] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:08 2022] PUT /identity/v3/projects/16ffd675672740e9b5d6a8a31baf1bc5/users/89e8db16b7e24f49887780368aa746c0/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:08.990585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:08.990943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:08.991293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:09.005143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc470b8044ed45a486efe79ec5854683', 'request_id': 'req-6b8fc6b7-cc40-4bdd-b837-989866bac382'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.025305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc470b8044ed45a486efe79ec5854683', 'request_id': 'req-6b8fc6b7-cc40-4bdd-b837-989866bac382'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.041765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc470b8044ed45a486efe79ec5854683', 'request_id': 'req-6b8fc6b7-cc40-4bdd-b837-989866bac382'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.055987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] MFA Rules not processed for user `89e8db16b7e24f49887780368aa746c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:09.061611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:09.199548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1145/2279] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:09.200636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:09.202234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:09.245132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] The token cache is being invalidate because project dc470b8044ed45a486efe79ec5854683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:09.245132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.245903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.260743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1135/2280] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:08 2022] DELETE /identity/v3/projects/dc470b8044ed45a486efe79ec5854683 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:09.260743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:09.261850 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:09.370968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1eeca5-3a77-4a64-9b9f-deb45e3486cd None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:09.395507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:09.397035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:09.402829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:09.402829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] PATH_INFO: `/v3/users/1e4c2462eb12418884fd306ffbca2893` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:09.402829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4c2462eb12418884fd306ffbca2893)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:09.402829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:09.445199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fc6b7-cc40-4bdd-b837-989866bac382 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:09.451227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:09.451783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:09.452057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:09.452325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:09.453016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:09.455311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:09.608490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1136/2281] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:09 2022] POST /identity/v3/projects => generated 379 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:09.613075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:09.728449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42a05-fb33-44c9-bad9-f2f025f197ce admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:09.739569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:09.740275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:09.740910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:09.741193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:09.742065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:09.744276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625faf82-2bf4-460e-bb3f-6612387b1480 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:09.745754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4c2462eb12418884fd306ffbca2893'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.747086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4c2462eb12418884fd306ffbca2893'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.748053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4c2462eb12418884fd306ffbca2893'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.778150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4c2462eb12418884fd306ffbca2893'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:09.797826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4c2462eb12418884fd306ffbca2893'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:10.053240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1137/2282] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:09 2022] POST /identity/v3/users => generated 296 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:10.061002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46cfc9-c93d-4e5f-b9d4-a66334aa7f2e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.062130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46cfc9-c93d-4e5f-b9d4-a66334aa7f2e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.062929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46cfc9-c93d-4e5f-b9d4-a66334aa7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.091303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1146/2283] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:09 2022] DELETE /identity/v3/users/1e4c2462eb12418884fd306ffbca2893 => generated 0 bytes in 890 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:10.091303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.098882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.106602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0c46cfc9-c93d-4e5f-b9d4-a66334aa7f2e None None] MFA Rules not processed for user `3e79e8dbf9b24efcbfbd2c1e6f47e5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:10.108531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0c46cfc9-c93d-4e5f-b9d4-a66334aa7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.291203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1138/2284] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:10.293437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57884-f0de-4557-9662-394cbded08af None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.293985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57884-f0de-4557-9662-394cbded08af None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.294728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed57884-f0de-4557-9662-394cbded08af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.299609 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e322715-5517-42dd-ac59-d11b4027b585 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:10.311375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:10.311934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.312212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.312491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.314000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:10.315723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:10.325118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9ed57884-f0de-4557-9662-394cbded08af None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:10.326341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9ed57884-f0de-4557-9662-394cbded08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.332838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1147/2285] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:10.334015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.342216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:10.352876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1139/2286] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:10.364057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ae7a8-d1cf-4961-bb71-589a5749a47f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:10.365639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed57884-f0de-4557-9662-394cbded08af None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.373622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9ed57884-f0de-4557-9662-394cbded08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.386540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:10.397266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.397554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.397844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] PATH_INFO: `/v3/projects/09f3f79f06974396b40f54358e7e0763/users/a3854d4dc06e4cbe8353f8c8303a1e3b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.441937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f3f79f06974396b40f54358e7e0763, user_id=a3854d4dc06e4cbe8353f8c8303a1e3b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:10.445940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:10.534469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed57884-f0de-4557-9662-394cbded08af None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:10.544946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:10.545967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.546788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.547145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.561357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:10.564654 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af023a7-0690-4caa-8b17-282134b47ad1 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:10.582765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1140/2287] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:10.584155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.584446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.584733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.659184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:10.664158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.688250 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1148/2288] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:10 2022] PUT /identity/v3/projects/09f3f79f06974396b40f54358e7e0763/users/a3854d4dc06e4cbe8353f8c8303a1e3b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:10.692635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.797546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1141/2289] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:10.809574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.810483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cfefb0-32f6-4a1a-91ed-b870bb1f227d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:10.814445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.817308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:10.818074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.818538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.819124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.819961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:10.821948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:10.842239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1149/2290] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:10.850827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:10.867751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904a057-3c2e-4bdd-bf75-63cae5c57b39 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:10.874689 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:10.875965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.876392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.876675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] PATH_INFO: `/v3/projects/09f3f79f06974396b40f54358e7e0763/users/a3854d4dc06e4cbe8353f8c8303a1e3b/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.880683 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f3f79f06974396b40f54358e7e0763, user_id=a3854d4dc06e4cbe8353f8c8303a1e3b, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:10.885291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc7469-9586-4713-9156-2257c5f2c814 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:10.897581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1150/2291] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:10 2022] PUT /identity/v3/projects/09f3f79f06974396b40f54358e7e0763/users/a3854d4dc06e4cbe8353f8c8303a1e3b/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:10.912406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:10.913237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:10.913724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:10.951538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] MFA Rules not processed for user `a3854d4dc06e4cbe8353f8c8303a1e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:10.953293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:10.953469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b7d80-9980-4b06-8d15-db981637571e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:11.136758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1151/2292] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:11.138268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:11.139767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:11.140774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:11.141544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:11.152000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:11.153560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:11.267180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6f2b-e10a-4b29-bf7e-9d5810e96cc6 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:11.279829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:11.280169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:11.281057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:11.281481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:11.281767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:11.282378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:11.297092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:11.298654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:11.304793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1142/2293] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:58:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:58:11.325102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1152/2294] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:11.436002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:11.437942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:11.518278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:11.528313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:11.534393 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71d188-f63b-42ad-a405-7e41b6af7921 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:11.539857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:11.541607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:11.542404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:11.542404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:11.544246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:11.585243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33950506-401d-4cf1-b7ff-7103e16accf2 service swift] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:11.593064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:11.594620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:11.595033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:11.595384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] PATH_INFO: `/v3/projects/92ec24068d3c4a3a8290825e6c398cf5` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:11.596840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ec24068d3c4a3a8290825e6c398cf5)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:11.599631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:11.648025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:11.649751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:11.660119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1153/2295] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:11.764291 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ec24068d3c4a3a8290825e6c398cf5', 'request_id': 'req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:11.778186 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ec24068d3c4a3a8290825e6c398cf5', 'request_id': 'req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:11.789156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ec24068d3c4a3a8290825e6c398cf5', 'request_id': 'req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:11.930284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] The token cache is being invalidate because project 92ec24068d3c4a3a8290825e6c398cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:11.930555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:11.934019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:11.954157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1143/2296] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:11 2022] DELETE /identity/v3/projects/92ec24068d3c4a3a8290825e6c398cf5 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:11.959540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:11.984898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06d1ac-79d8-4b0d-89cd-1014ca9fc483 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:12.104765 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:12.105767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:12.106227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:12.106677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] PATH_INFO: `/v3/users/11811d26e37440f6940d4604368fea76` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:12.110571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11811d26e37440f6940d4604368fea76)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:12.113667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:12.479309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11811d26e37440f6940d4604368fea76'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:12.486526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11811d26e37440f6940d4604368fea76'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:12.488134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11811d26e37440f6940d4604368fea76'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:12.506862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11811d26e37440f6940d4604368fea76'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:12.551910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-e9816b3a-6cb4-482d-b20d-85bd6aaf3d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11811d26e37440f6940d4604368fea76'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:12.649125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1154/2297] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:11 2022] DELETE /identity/v3/users/11811d26e37440f6940d4604368fea76 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:13.789796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:13.856059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:13.857976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:13.885234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fca1bd-5b31-47c8-8ea4-f9656b1e803d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:13.973073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:13.976596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:13.977470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:13.977830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] PATH_INFO: `/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:13.979306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9923017a7bf48b88d7b9788d6ac54cd)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:13.981795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:14.180408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9923017a7bf48b88d7b9788d6ac54cd', 'request_id': 'req-010750a9-202a-47a9-8825-95ed1b75658c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:14.189475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9923017a7bf48b88d7b9788d6ac54cd', 'request_id': 'req-010750a9-202a-47a9-8825-95ed1b75658c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:14.233822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9923017a7bf48b88d7b9788d6ac54cd', 'request_id': 'req-010750a9-202a-47a9-8825-95ed1b75658c'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:14.541499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] The token cache is being invalidate because project b9923017a7bf48b88d7b9788d6ac54cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:14.541832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:14.545340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-010750a9-202a-47a9-8825-95ed1b75658c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:14.547601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1144/2298] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:13 2022] DELETE /identity/v3/projects/b9923017a7bf48b88d7b9788d6ac54cd => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:14.555073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:14.555668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:14.556018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:14.590955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:14.596391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:14.904675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1155/2299] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:14.912670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:14.914215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:14.915133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:14.975839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:14.980480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:15.022595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:15.029310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1145/2300] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:15.037711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:15.041171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cea46-a631-4197-8174-d65b491de6b1 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:15.064771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:15.068142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:15.068755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:15.069370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:15.074039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:15.075133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:15.086620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:15.128655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1156/2301] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:58:15.130198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:15.148229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d9f8-08b9-44dd-ad8a-2118d111b468 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:15.168191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:15.169345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:15.169345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:15.169827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:15.170581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:15.172663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:15.390629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1146/2302] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:15 2022] POST /identity/v3/projects => generated 383 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:15.395974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:15.435884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92dbab-aa0e-4a38-87f2-e0ec9cb9963c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:15.648779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:15.648779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:15.648779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:15.649890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:15.650019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:15.652206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:15.925981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1157/2303] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:15 2022] POST /identity/v3/users => generated 292 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:15.970181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:15.970181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8983236-889e-4408-bd0a-dfc057b9110e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:15.970181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:15.970181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:15.971912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:15.971912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:15.971912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:15.971912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:15.971912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1147/2304] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:15.973001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:15.987986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd887b-d38d-4317-b640-3eee64a045e0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:15.997122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:15.998445 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:15.998894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:15.999410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:16.000405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:16.003317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3bc900-85f7-419a-8e18-69231a73ecc3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:16.025947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1158/2305] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:16.032930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:16.045729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d089-ab4c-4f95-9d7a-7ac0215e2e03 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:16.052489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:16.053908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:16.054301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:16.054602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] PATH_INFO: `/v3/projects/d3c9ab275b714382b01f09e1671bbc0d/users/cc5cb7a432dd44ee860fe1c98290d1f4/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:16.074240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c9ab275b714382b01f09e1671bbc0d, user_id=cc5cb7a432dd44ee860fe1c98290d1f4, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:16.077281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:16.706609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1148/2306] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:16 2022] PUT /identity/v3/projects/d3c9ab275b714382b01f09e1671bbc0d/users/cc5cb7a432dd44ee860fe1c98290d1f4/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:16.716013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988bdd8-553d-4eb0-965c-13555d2fa95e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:16.717027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988bdd8-553d-4eb0-965c-13555d2fa95e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:16.717687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988bdd8-553d-4eb0-965c-13555d2fa95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:16.802088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c988bdd8-553d-4eb0-965c-13555d2fa95e None None] MFA Rules not processed for user `cc5cb7a432dd44ee860fe1c98290d1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:16.809585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c988bdd8-553d-4eb0-965c-13555d2fa95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:16.910034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1159/2307] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:16.921731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:16.923541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:16.985190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aabb6-0a9f-4615-8d74-c7a0bc3501ab None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:16.985488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aabb6-0a9f-4615-8d74-c7a0bc3501ab None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:16.985767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aabb6-0a9f-4615-8d74-c7a0bc3501ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:16.990438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ad8d-4a00-479a-ab8f-42c06c3d38ff admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:16.994451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:16.994711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:16.994988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:16.995257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:17.006146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:17.006745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-bc2aabb6-0a9f-4615-8d74-c7a0bc3501ab None None] MFA Rules not processed for user `e9e1efb821884a09a39371bc5b792a83`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:17.007661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:17.007985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bc2aabb6-0a9f-4615-8d74-c7a0bc3501ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:17.018840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1149/2308] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:17.074050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1160/2309] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:17.391245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:18.793995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:18.795668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:19.007346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb70cc1-04dc-4b7c-bcc3-c6b7aa90cbf0 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:19.020001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:19.020599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:19.020920 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:19.021195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] PATH_INFO: `/v3/users/d3f672b799a84886876b49c93181d6b1` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:19.022491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f672b799a84886876b49c93181d6b1)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:19.024496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:19.442047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f672b799a84886876b49c93181d6b1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:19.443909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f672b799a84886876b49c93181d6b1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:19.445191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f672b799a84886876b49c93181d6b1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:19.586108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f672b799a84886876b49c93181d6b1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:19.597437 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f672b799a84886876b49c93181d6b1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:19.641122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1150/2310] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:18 2022] DELETE /identity/v3/users/d3f672b799a84886876b49c93181d6b1 => generated 0 bytes in 844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:19.644373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:19.645685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:19.646259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:19.791636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:19.793064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:19.970025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1161/2311] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:19.982157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:19.984223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:20.139608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45953b9-7396-4da1-8dc4-77105237d6e9 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:20.145342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:20.146462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:20.147126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:20.147825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:20.167347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:20.170471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:20.172609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:20.220251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1151/2312] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:21.174804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:21.178184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:21.219583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7402b0-0cd9-496e-b43a-33bd961814a1 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:21.227864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:21.228437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:21.228801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:21.229022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] PATH_INFO: `/v3/projects/cdac3a28c77d4194ba94831374942d86` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:21.230557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdac3a28c77d4194ba94831374942d86)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:21.232913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:21.538801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdac3a28c77d4194ba94831374942d86', 'request_id': 'req-0198c588-599b-4be3-87d5-4321002346dc'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:21.716955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdac3a28c77d4194ba94831374942d86', 'request_id': 'req-0198c588-599b-4be3-87d5-4321002346dc'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:21.727472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdac3a28c77d4194ba94831374942d86', 'request_id': 'req-0198c588-599b-4be3-87d5-4321002346dc'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:21.743756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] The token cache is being invalidate because project cdac3a28c77d4194ba94831374942d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:21.744411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:21.745440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:21.754126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:21.755809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1162/2313] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:21 2022] DELETE /identity/v3/projects/cdac3a28c77d4194ba94831374942d86 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:21.811800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a1406-f471-4725-815e-fff5b5c21fa6 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:21.867066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:21.954217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:21.956532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:21.957101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:21.957615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] PATH_INFO: `/v3/users/89e8db16b7e24f49887780368aa746c0` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:21.959410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e8db16b7e24f49887780368aa746c0)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:21.962199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:22.418996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e8db16b7e24f49887780368aa746c0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:22.420645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e8db16b7e24f49887780368aa746c0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:22.421084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e8db16b7e24f49887780368aa746c0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:22.632806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e8db16b7e24f49887780368aa746c0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:22.641535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e8db16b7e24f49887780368aa746c0'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:22.664035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1152/2314] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:21 2022] DELETE /identity/v3/users/89e8db16b7e24f49887780368aa746c0 => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:23.340474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:23.342582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:23.365376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198c588-599b-4be3-87d5-4321002346dc admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:23.489839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:23.491098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:23.491805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:23.492499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] PATH_INFO: `/v3/projects/16ffd675672740e9b5d6a8a31baf1bc5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:23.493925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ffd675672740e9b5d6a8a31baf1bc5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:23.496071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:23.701211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ffd675672740e9b5d6a8a31baf1bc5', 'request_id': 'req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:23.821424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ffd675672740e9b5d6a8a31baf1bc5', 'request_id': 'req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:23.829599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ffd675672740e9b5d6a8a31baf1bc5', 'request_id': 'req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:23.844546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] The token cache is being invalidate because project 16ffd675672740e9b5d6a8a31baf1bc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:23.844884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:23.846464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-1a13472f-ef6f-45a4-8461-ef4dba6c2fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:23.854145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:23.854694 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1163/2315] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:23 2022] DELETE /identity/v3/projects/16ffd675672740e9b5d6a8a31baf1bc5 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:23.855618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:23.879978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0e8d6-1e66-4fa3-9556-a40eb2506473 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:24.001478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:24.002989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:24.003462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:24.003911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] PATH_INFO: `/v3/users/a3854d4dc06e4cbe8353f8c8303a1e3b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:24.006095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3854d4dc06e4cbe8353f8c8303a1e3b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:24.008222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:24.321963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3854d4dc06e4cbe8353f8c8303a1e3b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:24.328777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3854d4dc06e4cbe8353f8c8303a1e3b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:24.330329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3854d4dc06e4cbe8353f8c8303a1e3b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:24.475462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3854d4dc06e4cbe8353f8c8303a1e3b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:24.491572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3854d4dc06e4cbe8353f8c8303a1e3b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:24.525221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1153/2316] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:23 2022] DELETE /identity/v3/users/a3854d4dc06e4cbe8353f8c8303a1e3b => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:24.531006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:24.584241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:24.586546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:24.587081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:24.630664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:24.632558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:24.732042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1164/2317] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:24.734828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:24.737009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:24.827022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeb258-828c-4ea2-9c3b-91493db18c00 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:24.833194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:24.834015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:24.834293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:24.834562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:24.850479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:24.853319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064c6d-3c25-4a58-8a6e-e1ee206661c4 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:24.863219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1154/2318] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:58:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:58:26.275193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:26.277144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:26.421418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff9bf7-42e7-4b29-987f-d5a4c7f92053 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:26.436903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:26.437883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:26.438330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:26.438768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] PATH_INFO: `/v3/projects/09f3f79f06974396b40f54358e7e0763` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:26.440593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f3f79f06974396b40f54358e7e0763)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:26.442888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:26.682129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f3f79f06974396b40f54358e7e0763', 'request_id': 'req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:26.809217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f3f79f06974396b40f54358e7e0763', 'request_id': 'req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:26.819500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f3f79f06974396b40f54358e7e0763', 'request_id': 'req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:26.838693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] The token cache is being invalidate because project 09f3f79f06974396b40f54358e7e0763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:26.839364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:26.840228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3fa03975-bb97-4c01-81c6-6fc9af1de1d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:26.849831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1165/2319] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:26 2022] DELETE /identity/v3/projects/09f3f79f06974396b40f54358e7e0763 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:26.850058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:26.850547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:26.850695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:26.880401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:26.882614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:26.967247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1155/2320] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:26.977592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:26.977918 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:26.978159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.003442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:27.006054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:27.034870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1166/2321] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:27.038793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.050472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d922b6c-cf04-4222-8b41-f5361a369634 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.058279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.059308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.059820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.060811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.061686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:27.067760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.067760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:27.079065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1156/2322] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 14:58:27.083956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.093978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a612a59-548a-4299-b227-398fa8cd94bf None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.102155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.102942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.103040 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.103314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.103992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.105980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:27.266884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1167/2323] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:27 2022] POST /identity/v3/projects => generated 373 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:27.271994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.285521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdc326-3228-45a3-81df-403af367205b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.345790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.362101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.362101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.362101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.362101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.362101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:27.541749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:27.667330 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1157/2324] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:27 2022] POST /identity/v3/users => generated 287 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:27.667897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.684552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a1b7-0ffe-4df3-baf2-692ccad166be admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.691569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.692704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.705495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.705495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.705495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.705495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:27.711391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1168/2325] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:27.715579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.727007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea86c6c-346e-4ee0-a937-7b99d543ae96 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.731890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.732594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.732901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.733170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.733819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.735418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1b44e-b541-47e0-ac90-d4e2e580662e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:27.765514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1158/2326] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:58:27.771378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:27.798574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6c726-0d5a-4bbd-9e37-fc8c73d4303e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:27.804194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:27.811272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:27.811272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:27.811272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] PATH_INFO: `/v3/projects/ceb55264459941e4aba8155679a1851e/users/8a1ea67af81a4369b127aa274a9bb612/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:27.827745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceb55264459941e4aba8155679a1851e, user_id=8a1ea67af81a4369b127aa274a9bb612, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:27.831887 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:28.001274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1169/2327] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:27 2022] PUT /identity/v3/projects/ceb55264459941e4aba8155679a1851e/users/8a1ea67af81a4369b127aa274a9bb612/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:28.008099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:28.008613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:28.008706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:28.028698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:28.030023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:28.108261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1159/2328] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:28.125514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:28.128127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:28.187914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef1ea1-d49a-4cb5-8bd0-d380a9b2f664 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:28.193579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:28.194214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:28.194492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:28.194932 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:28.214527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:28.216170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6884fc5-47a3-41c8-b5a9-be192ea2aaab service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:28.227267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1170/2329] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:28.839881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:30.227542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:30.227542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:30.242827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb34d9-f451-45f2-8a5b-88e77f20fe2f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:30.248278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:30.248958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:30.249236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:30.249508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] PATH_INFO: `/v3/users/cc5cb7a432dd44ee860fe1c98290d1f4` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:30.250680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5cb7a432dd44ee860fe1c98290d1f4)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:30.253443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:30.488566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:30.489150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:30.489150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:30.526984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] MFA Rules not processed for user `8a1ea67af81a4369b127aa274a9bb612`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:30.529195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:30.534017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5cb7a432dd44ee860fe1c98290d1f4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:30.535846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5cb7a432dd44ee860fe1c98290d1f4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:30.537500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5cb7a432dd44ee860fe1c98290d1f4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:30.616848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1171/2330] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:30.621416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:30.622731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:30.636843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ca0af-245b-4ee1-bbdb-693b968a3ef3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:30.642060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:30.643083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:30.643362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:30.643635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:30.644305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:30.646341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:30.678110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5cb7a432dd44ee860fe1c98290d1f4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:30.688238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5cc057d3-1d33-463c-b853-b8f5aaf5dd3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5cb7a432dd44ee860fe1c98290d1f4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:30.715695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1160/2331] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:30 2022] DELETE /identity/v3/users/cc5cb7a432dd44ee860fe1c98290d1f4 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:30.723540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:30.724119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:30.724752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:30.749981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:30.753255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:30.816066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1172/2332] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:30 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:58:30.818478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:30.831467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1161/2333] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:30.848577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:30.850625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:30.929622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b78f-679d-49d4-a7aa-8a9cbf62a926 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:30.995166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:30.995924 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:30.996304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:30.996746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:30.998539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b6084b-048f-43a6-a2ea-77452e6003f1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.008363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.009401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.010280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.012952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.013406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.013854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.014920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.019107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.023251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1162/2334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:31.256541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1173/2335] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:30 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:31.257502 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.270138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481e1ae-1651-4793-9241-ede90cc81480 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.276916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.278022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.278315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.278772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.279828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.281536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.297331 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.297605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1163/2336] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:31.310045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0beae-0043-4c46-92a4-b4342801c5b9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.316116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.317249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.317605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.317975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] PATH_INFO: `/v3/projects/bdcb9426e0144cbbb0b270977f4d4862/users/281ac307e9f84bde894bb05d6a3474e3/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.381917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcb9426e0144cbbb0b270977f4d4862, user_id=281ac307e9f84bde894bb05d6a3474e3, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.381917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.529759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1174/2337] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:31 2022] PUT /identity/v3/projects/bdcb9426e0144cbbb0b270977f4d4862/users/281ac307e9f84bde894bb05d6a3474e3/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:31.535374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.559340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c73eb-fc45-4870-974a-93a5326d1839 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.570452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.572840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:31.595509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:31.665933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.666545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.667035 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.667286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.668075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.669796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.678783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79e135-8b37-4f8c-b507-93cca6daed43 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.681104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1164/2338] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:31.684337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.685030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.685446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.685572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.685723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] PATH_INFO: `/v3/users/2d787e88278341b69b9f1ca9f052fb56` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.686904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d787e88278341b69b9f1ca9f052fb56)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.689718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.696581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d2d20-d816-49f0-a2f8-7fefdf32cc6f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.700519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:31.703752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.704446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.704830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.705139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] PATH_INFO: `/v3/projects/bdcb9426e0144cbbb0b270977f4d4862/users/281ac307e9f84bde894bb05d6a3474e3/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.707126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdcb9426e0144cbbb0b270977f4d4862, user_id=281ac307e9f84bde894bb05d6a3474e3, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.709872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:31.721980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1165/2339] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:31 2022] PUT /identity/v3/projects/bdcb9426e0144cbbb0b270977f4d4862/users/281ac307e9f84bde894bb05d6a3474e3/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:31.839959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:31.841832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:31.972307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ab68-fe11-4673-ad68-b554b3ee1f09 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:31.980891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:31.981465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:31.981743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:31.982040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] PATH_INFO: `/v3/projects/d3c9ab275b714382b01f09e1671bbc0d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:31.983180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c9ab275b714382b01f09e1671bbc0d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:31.985377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:32.115886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d787e88278341b69b9f1ca9f052fb56'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.116644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d787e88278341b69b9f1ca9f052fb56'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.117369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d787e88278341b69b9f1ca9f052fb56'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.126344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d787e88278341b69b9f1ca9f052fb56'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.142465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-43f92ff5-2b34-4aba-9f03-5bda86ef86a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d787e88278341b69b9f1ca9f052fb56'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.190018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c9ab275b714382b01f09e1671bbc0d', 'request_id': 'req-33b54b69-0c43-41cc-b9af-ff8480e77a87'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.197908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c9ab275b714382b01f09e1671bbc0d', 'request_id': 'req-33b54b69-0c43-41cc-b9af-ff8480e77a87'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.209279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c9ab275b714382b01f09e1671bbc0d', 'request_id': 'req-33b54b69-0c43-41cc-b9af-ff8480e77a87'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.324452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1175/2340] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:31 2022] DELETE /identity/v3/users/2d787e88278341b69b9f1ca9f052fb56 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:32.432222 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] The token cache is being invalidate because project d3c9ab275b714382b01f09e1671bbc0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:32.432851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.433376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-33b54b69-0c43-41cc-b9af-ff8480e77a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:32.434953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1166/2341] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:31 2022] DELETE /identity/v3/projects/d3c9ab275b714382b01f09e1671bbc0d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:58:32.440746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:32.441347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:32.442385 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:32.487750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:32.489130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:32.588699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1176/2342] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:32.597848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:32.598561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:32.599333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:32.634607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:32.639458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:32.650535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1167/2343] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:32.655314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:32.672538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc36735-8b18-45ed-81ed-d669e438c467 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:32.678806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:32.679746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:32.680356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:32.680903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:32.685587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:32.686149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:32.688636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:32.716294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:32.716914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1177/2344] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:58:32.730671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9105d14-e6e9-4acf-b1f4-0d95a98d2760 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:32.745734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:32.746682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:32.747226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:32.747699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:32.748441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:32.753479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:32.988879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.003899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.031688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1168/2345] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:32 2022] POST /identity/v3/projects => generated 375 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:33.037589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.066793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4656f1-cd7e-4401-b64e-d3456910db01 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.139668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9a445-0509-418f-b8e0-fb3d5d64c839 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.146666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.147833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.149040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.149637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.151016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.154451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b6310-9522-4e69-ba2a-a5b8ee99e24e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.221948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.222603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.222881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.223153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] PATH_INFO: `/v3/projects/719739539ba94f25af32e0f863a5a5dc` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.224778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=719739539ba94f25af32e0f863a5a5dc)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.227141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.337450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1169/2346] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:33 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:33.338877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.339163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.339509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.411207 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:33.413624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '719739539ba94f25af32e0f863a5a5dc', 'request_id': 'req-54b3959a-47c3-4f75-b881-4370f1672942'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:33.414883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.497018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1170/2347] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:33.499618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.541349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '719739539ba94f25af32e0f863a5a5dc', 'request_id': 'req-54b3959a-47c3-4f75-b881-4370f1672942'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:33.552561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '719739539ba94f25af32e0f863a5a5dc', 'request_id': 'req-54b3959a-47c3-4f75-b881-4370f1672942'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:33.585359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] The token cache is being invalidate because project 719739539ba94f25af32e0f863a5a5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:33.585571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:33.586316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:33.591794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1178/2348] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:32 2022] DELETE /identity/v3/projects/719739539ba94f25af32e0f863a5a5dc => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:33.592840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.608432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.617257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f610f40-acad-4972-ac12-8475f3295833 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.633655 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.634297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.634769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.635194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.637713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.639353 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bfa867-a93e-44c4-bdca-9f5824fc4bf1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.668793 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1171/2349] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:33.670188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.670474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.670747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.709603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:33.716412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.727567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1172/2350] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:33.728759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.730634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.745990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dafad9-8ac3-4ef7-a249-7314e8acde0c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.752229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.753144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.753594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.754012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.754842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.756908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2e62f-d21f-4428-9873-1c223886485f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.770888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1173/2351] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:33.772455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.773206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.773773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.777823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3959a-47c3-4f75-b881-4370f1672942 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.787146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.788356 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.788744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.789098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.792629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.810684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:33.811403 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.812781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:33.813501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.825547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1174/2352] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:33.826764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.832392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1179/2353] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:58:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:58:33.838072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.840868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0610b-b9bf-427f-8a59-9fd917ff0e67 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.851976 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabeacb-be3d-4397-9354-55a22debb638 service swift] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.854699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.855697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.855979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.856414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] PATH_INFO: `/v3/projects/97f7c76e5354400cb325aea9de677bb8/users/81e4aa3cb25d4341b562da16c0b4835b/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.863198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.864136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.864575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.865066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.866044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:33.866522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.868923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.879379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f7c76e5354400cb325aea9de677bb8, user_id=81e4aa3cb25d4341b562da16c0b4835b, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.884059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d30eb-e350-48e9-b4c0-7733c0b17d20 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:33.895598 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1180/2354] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:58:33.900453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:33.914944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7625f9-d20a-4b3e-9cde-50cd374e24c9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:33.924280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:33.924280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:33.924280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:33.924280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:33.924763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:33.925994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:34.112231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1175/2355] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:33 2022] PUT /identity/v3/projects/97f7c76e5354400cb325aea9de677bb8/users/81e4aa3cb25d4341b562da16c0b4835b/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:34.119051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.119658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.120038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.154751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1181/2356] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:33 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:34.156281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:34.187471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] MFA Rules not processed for user `81e4aa3cb25d4341b562da16c0b4835b`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:34.191346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:34.282706 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613feaeb-044f-4115-a5eb-626cffca5ad2 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:34.289719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:34.290854 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.291271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.291860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.292659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:34.303668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:34.348061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1176/2357] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:34.363210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:34.365294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:34.475998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1182/2358] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:34 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:34.481226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:34.509030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85254e55-63cb-4c38-ae52-e5c399522372 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:34.531536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:34.532249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.532535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.536116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6ee5d-8cb5-40a5-84ae-42ba3df2f8a4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:34.547681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.548562 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:34.550426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:34.556570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:34.557237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.560194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.560194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.595695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:34.597297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:34.601720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1183/2359] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:58:34.603428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:34.624828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3ca52-49dd-4425-9aae-8fcfb102942b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:34.646408 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:34.647522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1177/2360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:58:34.648931 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.650134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.651261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.652837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:34.656101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d3bda-3375-427e-a4a7-f9f6bbf2f59b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:34.663993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:34.700195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1184/2361] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:34.700975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:34.726493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c7afe-d19a-4edf-bf9d-df43408077c3 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:34.747145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:34.748177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:34.748657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:34.749141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] PATH_INFO: `/v3/projects/a4d9befe97ee4cda9fd3c3303f74da88/users/6c3fd726007042bfb13bac4fc1e3c24a/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:34.773103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:34.789210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d9befe97ee4cda9fd3c3303f74da88, user_id=6c3fd726007042bfb13bac4fc1e3c24a, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:34.797084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec505e-b781-4894-94ca-a9b3fa6603a5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:35.058185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1178/2362] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:34 2022] PUT /identity/v3/projects/a4d9befe97ee4cda9fd3c3303f74da88/users/6c3fd726007042bfb13bac4fc1e3c24a/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:35.068792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:35.069032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:35.069330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:35.134514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda0d2-0a77-4dc0-9b31-357d6e964e5c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:35.134809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda0d2-0a77-4dc0-9b31-357d6e964e5c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:35.135071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbda0d2-0a77-4dc0-9b31-357d6e964e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:35.198267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5fbda0d2-0a77-4dc0-9b31-357d6e964e5c None None] MFA Rules not processed for user `281ac307e9f84bde894bb05d6a3474e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:35.200182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5fbda0d2-0a77-4dc0-9b31-357d6e964e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.248963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] MFA Rules not processed for user `6c3fd726007042bfb13bac4fc1e3c24a`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:35.250549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.357790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1179/2363] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:35.382578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:35.383749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:35.385232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:35.441520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] MFA Rules not processed for user `8a1ea67af81a4369b127aa274a9bb612`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:35.443571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.477198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1185/2364] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:35.492362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:35.509881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.574747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1180/2365] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:35.591936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8b4aa-6bd3-458d-8890-913cd1a2887f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:35.596495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:35.596671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:35.597044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:35.597320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:35.606291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:35.607768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0d7942-36ce-4599-a5d9-bd6d51361ed9 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:35.617633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1186/2366] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:58:35.684742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:35.686915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.762121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc1e8d-4acf-4528-96d8-9e9d80f541c2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:35.768280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:35.768932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:35.769212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:35.769482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:35.771236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:35.782885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:35.784501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1cb46-102d-4525-91c1-a64c6fedc3dc service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:35.794682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1181/2367] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:36.165872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:36.166160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:36.166493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:36.168308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1187/2368] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:58:36.175126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6681-95aa-46bd-9838-743644464e4f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:36.175413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6681-95aa-46bd-9838-743644464e4f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:36.175696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c6681-95aa-46bd-9838-743644464e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:36.203351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-868c6681-95aa-46bd-9838-743644464e4f None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:36.205237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-868c6681-95aa-46bd-9838-743644464e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:36.237733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:36.243791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:36.247898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1182/2369] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:36.368132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceffefd-a4d0-416b-b5a2-5c1800541b33 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:36.387405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:36.388210 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:36.388684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:36.389538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:36.419256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:36.420762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a873e3c-25a6-463e-9afc-77cda0ea7a79 service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:36.437076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1188/2370] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:37.621638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:37.622214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:37.622214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:37.623540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1183/2371] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 14:58:37.636464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ec48-531c-4a42-a732-88fa7128d7ad None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:37.643494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ec48-531c-4a42-a732-88fa7128d7ad None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:37.643494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83ec48-531c-4a42-a732-88fa7128d7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:37.678700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ac83ec48-531c-4a42-a732-88fa7128d7ad None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:37.681478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ac83ec48-531c-4a42-a732-88fa7128d7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:37.838005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1189/2372] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:58:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:37.888373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:37.890959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:37.933554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765c94-fa14-4bc7-ab07-6e409db46611 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:37.939401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:37.940504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:37.940995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:37.941378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:37.960598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:37.962428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689ffdd-44e8-44d1-b942-b2f6e8769add service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:37.988552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1184/2373] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:38.177620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:38.177942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:38.178297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:38.180335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1190/2374] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 14:58:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 14:58:38.208116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d73e-ab96-49d2-998b-f397140957a8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:38.208405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d73e-ab96-49d2-998b-f397140957a8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:38.208808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d73e-ab96-49d2-998b-f397140957a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:38.263370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-10b1d73e-ab96-49d2-998b-f397140957a8 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:38.267467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-10b1d73e-ab96-49d2-998b-f397140957a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:38.286428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1185/2375] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 14:58:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:38.293632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:38.295536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:38.317324 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5283b3-323c-4fbc-a1b8-5e8b79e7547f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:38.324827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:38.325744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:38.326034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:38.326402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:38.358738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:38.364041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:38.374955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:38.402570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1191/2376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:39.075481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:39.076103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:39.076201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:39.102316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] MFA Rules not processed for user `6c3fd726007042bfb13bac4fc1e3c24a`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:39.105467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:39.115163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1186/2377] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:40.050833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:41.630822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:43.490049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:44.135466 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:45.644310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:47.558534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:49.175437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:49.588891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:49.588891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:49.658257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:49.662385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:49.696201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c5f81-0c60-4180-8e39-69b284d2f424 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:49.702982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:49.704467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:49.705120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:49.705407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:49.708792 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:49.722345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:49.725102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6997044-c74b-41f3-849e-09b99aebe662 service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:49.740203 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1192/2378] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:49.770554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21312225-1865-4ca3-8010-d5a18b5f9a47 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:49.784659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:49.784659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:49.786187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:49.786187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:49.799260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:49.801389 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:49.819733 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1187/2379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:58:50.850187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:51.878770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:54.432195 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:54.434166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:54.434664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:54.457328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:54.458574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:54.560083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1193/2380] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:58:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:54.592073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:54.684762 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97eb0e-58fb-47bf-b401-f3a30dd324ee service placement] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:54.696135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:54.696836 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:54.697120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:54.697396 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:54.710234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:54.714919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cca594-4673-4dd0-9c81-a5385d9a8891 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:54.729361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1188/2381] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:58:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:58:54.743914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:55.792783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:55.894321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7ef3a-2a9f-4f0f-9501-64d1dad3a33c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:55.894321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:55.894321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:55.894321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:55.894843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] PATH_INFO: `/v3/users/81e4aa3cb25d4341b562da16c0b4835b` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:55.894843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e4aa3cb25d4341b562da16c0b4835b)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:55.895907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:56.060944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e4aa3cb25d4341b562da16c0b4835b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:56.062215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e4aa3cb25d4341b562da16c0b4835b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:56.063602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e4aa3cb25d4341b562da16c0b4835b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:56.073754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e4aa3cb25d4341b562da16c0b4835b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:56.095426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e4aa3cb25d4341b562da16c0b4835b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:56.207022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1194/2382] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:58:55 2022] DELETE /identity/v3/users/81e4aa3cb25d4341b562da16c0b4835b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:56.207202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:56.207202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:56.207202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:56.237669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:56.239338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:56.328480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1189/2383] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:56.340219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:56.343726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:56.484376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3399824e-384f-4be1-b17f-3e3e3f446389 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:56.495354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:56.495998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:56.496325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:56.496614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:56.514067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:56.516240 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048f37e7-6f00-49d0-8fd6-fecdd6df1ea2 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:56.567081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1195/2384] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:56.781229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:57.241152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:57.249596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:57.264301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdb00c-a2c8-40d7-8964-cde4842465f9 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:57.271811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:57.272808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:57.273457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:57.273897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] PATH_INFO: `/v3/projects/97f7c76e5354400cb325aea9de677bb8` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:57.275501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f7c76e5354400cb325aea9de677bb8)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:57.279475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:57.416254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f7c76e5354400cb325aea9de677bb8', 'request_id': 'req-54316c66-de1a-4b1e-a213-86d6e4f22213'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:57.426823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f7c76e5354400cb325aea9de677bb8', 'request_id': 'req-54316c66-de1a-4b1e-a213-86d6e4f22213'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:57.436748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f7c76e5354400cb325aea9de677bb8', 'request_id': 'req-54316c66-de1a-4b1e-a213-86d6e4f22213'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:57.546728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] The token cache is being invalidate because project 97f7c76e5354400cb325aea9de677bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:58:57.547042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:57.548090 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-54316c66-de1a-4b1e-a213-86d6e4f22213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:58:57.549921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1190/2385] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:58:57 2022] DELETE /identity/v3/projects/97f7c76e5354400cb325aea9de677bb8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:57.555332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:57.555999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:57.555999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:57.581143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:57.582703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:57.695724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1196/2386] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:57.697412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:57.697876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:57.698160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:57.745319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:57.746970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:57.757461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1191/2387] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:58:57.761756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:57.775064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256c7df-ca9b-4e59-a8c2-0c99bf51eeaf None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:57.782304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:57.783448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:57.783920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:57.784618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:57.785715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:58:57.786272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:57.788214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:57.817181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1197/2388] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:58:57.821179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:57.831069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960b656a-7bc6-43ce-b992-767459a111e1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:57.836728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:57.837446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:57.837805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:57.838072 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:57.838916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:57.841542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:57.964834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1192/2389] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:58:57 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:57.971554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:57.987679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98446a-0fc2-45ed-b1bd-87a65ac551a8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:58.121549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:58.122211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.122460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.122735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.123809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:58.125586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:58.255330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1198/2390] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:58:57 2022] POST /identity/v3/users => generated 286 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:58:58.256799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:58.272544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ba770-54ff-4d9b-8956-4de275e0d24f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:58.280482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:58.282683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.283399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.283953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.285460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:58.287715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:58.305220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1193/2391] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:58.309143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:58.320874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16312e1b-dd1e-4aab-9944-f15833dd378a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:58.327986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:58.328845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.329389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.330332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.330952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:58.332923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9634fc-ab35-4b2e-a580-189afa2c7387 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:58.348766 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1199/2392] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:58:58.355937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:58.370358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeb679-b668-4df0-a2d5-0c612eeb00fe admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:58.386614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:58.388132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.389168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.389457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] PATH_INFO: `/v3/projects/c8e19e329d8144f7afe4844cc4011684/users/953f96dc0e2142a7b378487583c6c5e2/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.421441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e19e329d8144f7afe4844cc4011684, user_id=953f96dc0e2142a7b378487583c6c5e2, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:58.425300 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:58.556397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1194/2393] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:58:58 2022] PUT /identity/v3/projects/c8e19e329d8144f7afe4844cc4011684/users/953f96dc0e2142a7b378487583c6c5e2/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:58:58.560935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d495c1-4d56-4b3c-9515-3a472f7a6c85 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.567992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d495c1-4d56-4b3c-9515-3a472f7a6c85 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.569173 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d495c1-4d56-4b3c-9515-3a472f7a6c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.596190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-42d495c1-4d56-4b3c-9515-3a472f7a6c85 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:58:58.597942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-42d495c1-4d56-4b3c-9515-3a472f7a6c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:58.694685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1200/2394] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:58:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:58:58.708172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:58:58.710402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:58:58.732778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:58:58.783587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a5f4b-7817-4555-b69c-70eef1787d56 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:58:58.787489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:58:58.788102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:58:58.788404 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:58:58.788671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:58:58.799927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:58:58.806532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:58:58.812644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1195/2395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:58:59.661860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:00.386661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:01.713197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:01.820427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:03.227337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:03.420701 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:06.034230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:06.329082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:07.728349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:07.729229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:07.729744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:07.764109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:07.782256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] MFA Rules not processed for user `953f96dc0e2142a7b378487583c6c5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:07.783512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:07.896081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1201/2396] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:07.898159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:07.912417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31548c-2688-4d32-851e-353c3dd40571 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:07.919438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:07.920328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:07.920824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:07.926346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:07.926346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:07.926346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.063962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1196/2397] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:59:08.066532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:08.079483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f80e70-fcd4-4247-82af-8f3bf96dd68f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:08.143660 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:08.144278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:08.144555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:08.144907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:08.145560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:08.147488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.278423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1202/2398] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:59:08 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:59:08.283250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:08.294640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e972-6631-42dd-b7ab-08ee88803ef1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:08.300128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:08.301007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:08.301289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:08.301564 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:08.302217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:08.303837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.314666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1197/2399] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:59:08.318863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:08.338892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6888096-5331-4c03-861a-f8931c7518c6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:08.346695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:08.347855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:08.348569 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:08.349100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] PATH_INFO: `/v3/projects/a3f9648e85a547bfa9e0584a84444873/users/12b850ab7aa04852a6e36ee00673e751/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:08.377012 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f9648e85a547bfa9e0584a84444873, user_id=12b850ab7aa04852a6e36ee00673e751, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:08.380776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.503456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1203/2400] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:59:08 2022] PUT /identity/v3/projects/a3f9648e85a547bfa9e0584a84444873/users/12b850ab7aa04852a6e36ee00673e751/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:59:08.507078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:08.518431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1231149-d813-4e66-8be9-d70c9d6f5806 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:08.524239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:08.590639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:08.591689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:08.592376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:08.592966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:08.593945 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:08.595901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.611773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1198/2401] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:59:08.613718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:08.627376 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21002272-c948-4d57-a11e-6196b4fa3122 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:08.633304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:08.634466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:08.634745 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:08.635579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] PATH_INFO: `/v3/projects/a3f9648e85a547bfa9e0584a84444873/users/12b850ab7aa04852a6e36ee00673e751/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:08.638848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f9648e85a547bfa9e0584a84444873, user_id=12b850ab7aa04852a6e36ee00673e751, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:08.643311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0596f-6fc5-48d5-a6b5-db1ed042051b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:08.673088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1204/2402] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:59:08 2022] PUT /identity/v3/projects/a3f9648e85a547bfa9e0584a84444873/users/12b850ab7aa04852a6e36ee00673e751/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:59:11.099797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:11.759478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:13.513208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:13.583582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0eaeb-af21-4fc8-87ac-068fd77dfb12 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:13.653576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:13.654225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:13.655103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:13.655721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:13.658230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:13.779397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:13.782688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:13.794561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1199/2403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:13.883645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:14.232857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:15.710612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:16.318514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:17.059757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4f-9b0e-4487-a2a8-886d45a64a33 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:17.059757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4f-9b0e-4487-a2a8-886d45a64a33 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:17.059757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff7d4f-9b0e-4487-a2a8-886d45a64a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:17.099679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a3ff7d4f-9b0e-4487-a2a8-886d45a64a33 None None] MFA Rules not processed for user `12b850ab7aa04852a6e36ee00673e751`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:17.101299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a3ff7d4f-9b0e-4487-a2a8-886d45a64a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:17.245199 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1205/2404] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:17.265183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:17.266586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:17.382577 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0b654-c881-40e6-8783-42fea46ce647 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:17.399259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:17.400062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:17.402184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:17.402184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:17.503522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:17.506089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:17.518534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1200/2405] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:17.620916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:18.363998 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:19.478539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be764d0-9af3-47a6-b3aa-109616868658 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:19.479145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be764d0-9af3-47a6-b3aa-109616868658 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:19.479772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be764d0-9af3-47a6-b3aa-109616868658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:19.514299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7be764d0-9af3-47a6-b3aa-109616868658 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:19.517877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7be764d0-9af3-47a6-b3aa-109616868658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:19.603353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1206/2406] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 14:59:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:19.627826 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:19.629287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:19.730573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ad004-808c-4aa6-83a3-2ae82c1e7f0e service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:19.738283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:19.740111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:19.740615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:19.741136 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:19.754783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:19.756568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855a583-dee6-4715-8086-d913c5adb8b4 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:19.769853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1201/2407] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:59:20.745542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:21.041432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:22.089718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:22.090367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:22.090367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:22.112064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] MFA Rules not processed for user `953f96dc0e2142a7b378487583c6c5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:22.113336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:22.120529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1207/2408] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:22.745473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:23.522906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571b24-11b9-4ab1-9ece-89f64e40377d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:23.523209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571b24-11b9-4ab1-9ece-89f64e40377d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:23.523488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c571b24-11b9-4ab1-9ece-89f64e40377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:23.547173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-6c571b24-11b9-4ab1-9ece-89f64e40377d None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:23.548442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6c571b24-11b9-4ab1-9ece-89f64e40377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:23.556077 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1202/2409] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:59:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:23.571674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:23.584595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117c157-b4bd-4cb2-a706-45b7a3260d7b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:23.590080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:23.595503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:23.595503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:23.595503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:23.601221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:23.602839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:23.621512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1208/2410] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:59:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:59:24.546781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:24.889467 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a75b4-42fb-4b22-9333-9d6d6a83d3e9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:24.890016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a75b4-42fb-4b22-9333-9d6d6a83d3e9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:24.890125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a75b4-42fb-4b22-9333-9d6d6a83d3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:24.912170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-170a75b4-42fb-4b22-9333-9d6d6a83d3e9 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:24.913557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-170a75b4-42fb-4b22-9333-9d6d6a83d3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:24.921075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1203/2411] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 14:59:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:24.934205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:24.954993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d74db-194e-4433-893e-ccf52609d6e0 service swift] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:24.954993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:24.954993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:24.954993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:24.955396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:24.960908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:24.962551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:24.971845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1209/2412] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:59:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:59:25.072496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:25.736147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:25.736431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:25.736726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:25.758040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:25.763551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:25.767521 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1204/2413] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 14:59:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:25.781042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:25.792410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00041d4a-a388-4b78-90bb-e9f2bb06ad5c service swift] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:25.798527 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:25.799154 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:25.799430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:25.799703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:25.821838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:25.832560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4fd91-42d7-4827-8ff6-b35515dbf246 service swift] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:25.833816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1210/2414] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 14:59:25.913308 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:25.915082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:25.985630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669c57f-843e-46ad-8033-2032ea58a11c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:25.989333 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:25.989941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:25.990219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:25.990491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:25.992241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:26.060079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:26.062160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:26.072452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1205/2415] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:26.686143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:26.686680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:26.686782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:26.710232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:26.717749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:26.719085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1211/2416] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 14:59:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:59:26.731576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:26.743570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b4b37-3d7b-48aa-8970-22117d2284f1 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:26.763244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:26.763244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:26.763244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:26.763244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:26.763738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:26.763738 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15737318-b0cc-4ce2-bda8-dd1a05c1ec28 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:26.769608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1206/2417] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 14:59:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 14:59:27.826295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:28.106773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:29.854437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:29.855905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:29.926568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41072-7c8d-4e4b-b57a-0e2ad97d072a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:29.931504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:29.932155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:29.932430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:29.932700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] PATH_INFO: `/v3/users/6c3fd726007042bfb13bac4fc1e3c24a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:29.933936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3fd726007042bfb13bac4fc1e3c24a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:29.935882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:29.992161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:30.158223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3fd726007042bfb13bac4fc1e3c24a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.162698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3fd726007042bfb13bac4fc1e3c24a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.162698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3fd726007042bfb13bac4fc1e3c24a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.170961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3fd726007042bfb13bac4fc1e3c24a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.185097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3fd726007042bfb13bac4fc1e3c24a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.214742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:30.294942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1212/2418] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:59:29 2022] DELETE /identity/v3/users/6c3fd726007042bfb13bac4fc1e3c24a => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:30.299888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:30.300165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:30.300473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:30.320390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:30.321620 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:30.391261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1207/2419] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:30.400928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:30.402409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:30.464256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5d33f-a7a0-4ad5-bd4d-a304ca5d57c6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:30.467778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:30.468391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:30.468806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:30.469145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:30.478880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:30.480319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935614e-8ce2-4afb-934a-66754e160ca2 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:30.491064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1213/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 14:59:30.803799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:30.805598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:30.820223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc8400-1b5d-4ac8-95ff-8ba5fafe3556 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:30.834455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:30.835533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:30.836699 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:30.837315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] PATH_INFO: `/v3/projects/a4d9befe97ee4cda9fd3c3303f74da88` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:30.839996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d9befe97ee4cda9fd3c3303f74da88)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:30.842147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:30.972064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d9befe97ee4cda9fd3c3303f74da88', 'request_id': 'req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.980475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d9befe97ee4cda9fd3c3303f74da88', 'request_id': 'req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:30.988975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d9befe97ee4cda9fd3c3303f74da88', 'request_id': 'req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:31.088476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] The token cache is being invalidate because project a4d9befe97ee4cda9fd3c3303f74da88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:59:31.088800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:31.089536 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ac72cd09-9de2-4b6d-94af-78b8f7ccfdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:31.091043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1208/2421] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:59:30 2022] DELETE /identity/v3/projects/a4d9befe97ee4cda9fd3c3303f74da88 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:31.096788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.097276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.097370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.121588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:31.122837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:31.184659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:31.189428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1214/2422] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:31.196422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.196899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.197358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.223906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:31.224866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:31.237240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1209/2423] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:31.241599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.251641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017fb4f-2ae1-4b8a-824b-5ff442c173d7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.256846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.258279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.258707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.259149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.260007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:59:31.260834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.263111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.277308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1215/2424] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:59:31.282792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.294022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c20fb8-666f-415b-91fc-b95edc765833 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.299231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.299844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.300118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.300385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.301067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.302967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.434372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1210/2425] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:59:31 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:59:31.439114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.444788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:31.449696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f2fac6-37b5-41b6-aef2-2e10c8b0ec7d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.514865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.515397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.516378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.516729 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.517512 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.519449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.701632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1216/2426] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:59:31 2022] POST /identity/v3/users => generated 300 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:59:31.706527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.717049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6721cc3-bca0-4a50-af88-50645c9cefc9 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.722053 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.722659 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.722937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.723328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.723981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.726067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.738132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1211/2427] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:59:31.742380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.753592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2375f6-9d1c-4d3a-8b08-f7661b61a550 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.758536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.759139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.759503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.759857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.760618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.762253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff0d5b-eef2-41da-9a1a-6a3b0f5a62e7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.776149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1217/2428] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:59:31.779111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:31.789408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c209f6-c9d7-4401-b4ec-9bb300253961 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:31.794118 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:31.794758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.795029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.795296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] PATH_INFO: `/v3/projects/4d997afb8c98454c88b35d3ea76479a1/users/1816358484e542939fba17d0a4be184a/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:31.810046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d997afb8c98454c88b35d3ea76479a1, user_id=1816358484e542939fba17d0a4be184a, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:31.816890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:31.962780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1212/2429] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:59:31 2022] PUT /identity/v3/projects/4d997afb8c98454c88b35d3ea76479a1/users/1816358484e542939fba17d0a4be184a/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:31.975069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:31.975424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:31.975702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:32.007124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] MFA Rules not processed for user `1816358484e542939fba17d0a4be184a`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:32.008370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:32.087781 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1218/2430] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:32.100594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:32.102339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:32.169666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcceaad-05c6-43c5-aa60-ed18ddde918b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:32.175501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:32.176406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:32.176859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:32.177179 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:32.187276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:32.189381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac24d05a-1bb2-42d9-91d8-087385c7581f service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:32.200315 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1213/2431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:32 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:32.289773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:32.489438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:33.564904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:34.066479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:36.649558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:37.150513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:38.593261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:38.670008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fe531-032d-4adb-b8d2-bbbe9eba6f3b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:38.676151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:38.678870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:38.679202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:38.679492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] PATH_INFO: `/v3/users/1816358484e542939fba17d0a4be184a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:38.680948 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1816358484e542939fba17d0a4be184a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:38.683708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:38.992265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1816358484e542939fba17d0a4be184a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:38.992999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1816358484e542939fba17d0a4be184a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:38.993714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1816358484e542939fba17d0a4be184a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:39.001949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1816358484e542939fba17d0a4be184a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:39.013852 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1816358484e542939fba17d0a4be184a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:39.158516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1219/2432] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:59:38 2022] DELETE /identity/v3/users/1816358484e542939fba17d0a4be184a => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:39.163310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:39.163795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:39.163891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:39.183642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:39.184950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:39.247720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1214/2433] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:59:39.259181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:39.261328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:39.332585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792512b-5949-4496-9639-e81036f0ebeb admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:39.337205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:39.338505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:39.338505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:39.338719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:39.351107 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:39.353011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:39.365532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1220/2434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:39.673188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:39.918981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:39.927383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:39.933902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b7dd3-30a4-40e3-b65c-5e82fd4bce6b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:39.938709 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:39.939376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:39.939619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:39.939886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] PATH_INFO: `/v3/projects/4d997afb8c98454c88b35d3ea76479a1` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:39.941108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d997afb8c98454c88b35d3ea76479a1)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:39.943018 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:40.077589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:40.146552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d997afb8c98454c88b35d3ea76479a1', 'request_id': 'req-da49424b-a5cb-498e-bc88-faaba1d42e6b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:40.153720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d997afb8c98454c88b35d3ea76479a1', 'request_id': 'req-da49424b-a5cb-498e-bc88-faaba1d42e6b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:40.160194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d997afb8c98454c88b35d3ea76479a1', 'request_id': 'req-da49424b-a5cb-498e-bc88-faaba1d42e6b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:40.329304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] The token cache is being invalidate because project 4d997afb8c98454c88b35d3ea76479a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:59:40.329899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:40.330342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:40.335861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1215/2435] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:59:39 2022] DELETE /identity/v3/projects/4d997afb8c98454c88b35d3ea76479a1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:41.973343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:42.385109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:43.716557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:44.341535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:46.963669 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:47.719034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:49.363293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:49.872074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:50.878413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:51.758731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:52.081880 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:52.586305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:52.627380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:52.815594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:53.506416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:53.734679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:54.294008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:54.295102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:54.309242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836eaea7-6c07-494c-8a78-7323a4cce6b0 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:54.370011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:54.370645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:54.371156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:54.371284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] PATH_INFO: `/v3/users/8a1ea67af81a4369b127aa274a9bb612` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:54.372444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1ea67af81a4369b127aa274a9bb612)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:54.375200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:54.619235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1ea67af81a4369b127aa274a9bb612'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:54.620829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1ea67af81a4369b127aa274a9bb612'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:54.621525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1ea67af81a4369b127aa274a9bb612'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:54.632261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1ea67af81a4369b127aa274a9bb612'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:54.646545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1ea67af81a4369b127aa274a9bb612'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:54.761201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1221/2436] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:59:54 2022] DELETE /identity/v3/users/8a1ea67af81a4369b127aa274a9bb612 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:54.889820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.106205 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:55.108500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:55.118104 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:55.130380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49424b-a5cb-498e-bc88-faaba1d42e6b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:55.192644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:55.193306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:55.193580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:55.193848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] PATH_INFO: `/v3/projects/ceb55264459941e4aba8155679a1851e` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:55.195049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceb55264459941e4aba8155679a1851e)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:55.196980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:55.403339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceb55264459941e4aba8155679a1851e', 'request_id': 'req-c4d2c6cb-4f10-46f9-b5ec-f31359366595'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.411545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceb55264459941e4aba8155679a1851e', 'request_id': 'req-c4d2c6cb-4f10-46f9-b5ec-f31359366595'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.417775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceb55264459941e4aba8155679a1851e', 'request_id': 'req-c4d2c6cb-4f10-46f9-b5ec-f31359366595'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.506758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] The token cache is being invalidate because project ceb55264459941e4aba8155679a1851e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:59:55.507050 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.507811 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.509317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1216/2437] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:59:55 2022] DELETE /identity/v3/projects/ceb55264459941e4aba8155679a1851e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:59:55.513563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:55.515566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:55.528951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b39fd52-6f23-43b1-bb99-b19e36a20e75 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:55.587215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:55.587861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:55.588136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:55.588410 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] PATH_INFO: `/v3/users/281ac307e9f84bde894bb05d6a3474e3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:55.589581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=281ac307e9f84bde894bb05d6a3474e3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:55.591503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:55.877840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '281ac307e9f84bde894bb05d6a3474e3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.878638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '281ac307e9f84bde894bb05d6a3474e3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.879396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '281ac307e9f84bde894bb05d6a3474e3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.894916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '281ac307e9f84bde894bb05d6a3474e3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:55.908681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6a4218df-cf69-49a4-821c-b6d7e8fa9b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '281ac307e9f84bde894bb05d6a3474e3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.099070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1222/2438] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:59:55 2022] DELETE /identity/v3/users/281ac307e9f84bde894bb05d6a3474e3 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:56.414677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:56.416016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:56.417478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:56.431710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2c6cb-4f10-46f9-b5ec-f31359366595 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:56.506863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:56.507501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:56.507778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:56.508051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] PATH_INFO: `/v3/projects/bdcb9426e0144cbbb0b270977f4d4862` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:56.509344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdcb9426e0144cbbb0b270977f4d4862)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:56.511180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:56.631772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdcb9426e0144cbbb0b270977f4d4862', 'request_id': 'req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.638344 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdcb9426e0144cbbb0b270977f4d4862', 'request_id': 'req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.644787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdcb9426e0144cbbb0b270977f4d4862', 'request_id': 'req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.791573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] The token cache is being invalidate because project bdcb9426e0144cbbb0b270977f4d4862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:59:56.791827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.792458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3c1556c2-66d2-4473-b8f6-ffac222a2bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:56.794154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1217/2439] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:59:56 2022] DELETE /identity/v3/projects/bdcb9426e0144cbbb0b270977f4d4862 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:56.799169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:56.799449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:56.799722 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:56.819989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:56.821330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:56.887587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1223/2440] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:56.897042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:56.897322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:56.897591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:56.925839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:56.927089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:56.935327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1218/2441] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:56.939767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:56.949506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd29ae-688a-447a-9af2-844497a9ce4e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:56.954719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:56.955369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:56.955650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:56.955920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:56.956656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 14:59:56.956991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:56.958606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:56.976212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1224/2442] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 14:59:56.977446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:56.987272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6bb00-2318-49fe-9bc8-ba56c9dcee19 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:56.994405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:56.995038 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:56.995318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:56.995662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:56.996358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:56.998328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.037466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:57.166963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1219/2443] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 14:59:56 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 14:59:57.168628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.181422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5b55c-899f-4cc0-8915-af68d01920d3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.250868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.251687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.252059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.252427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.253374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.255505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.384742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:57.385220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1225/2444] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 14:59:57 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 14:59:57.393677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.414473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edfdf2-5d73-4c72-ae10-335834577fe1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.422103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.422817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.423321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.423722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.424511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.426976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.439541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1220/2445] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 14:59:57.443701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.454874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad1640-707b-4aef-98bf-cf22e6428c3d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.461989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.462631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.462910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.463181 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.463849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.465579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3171d9ad-d0f2-4f29-aec8-17fbd7d55d6a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.478797 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1226/2446] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 14:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 14:59:57.489870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.500814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ce5e6-dd33-47c6-91d5-47190cc66b67 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.506382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.507147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.507495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.507846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] PATH_INFO: `/v3/projects/abaae1678f8e47d7aa7a894683bb50e6/users/c99e053a8aae42fbbc97115eac9f6c47/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.524624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abaae1678f8e47d7aa7a894683bb50e6, user_id=c99e053a8aae42fbbc97115eac9f6c47, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.527292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.649360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1221/2447] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 14:59:57 2022] PUT /identity/v3/projects/abaae1678f8e47d7aa7a894683bb50e6/users/c99e053a8aae42fbbc97115eac9f6c47/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 14:59:57.660625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.660954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.661237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.700970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] MFA Rules not processed for user `c99e053a8aae42fbbc97115eac9f6c47`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:57.702449 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:57.773394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1227/2448] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 14:59:57.785606 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.787479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:57.861988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dacc3d-b719-46cd-92ef-f9865c819d36 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.866044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.866658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.866937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.867204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.877488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.878958 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7515da6-25bf-4c50-b4ba-af89be9d6a8f service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:57.889657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1222/2449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:57.914223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:57.981711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fa8ba-0313-4547-b24f-2b7126aa0c82 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:57.987479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:57.988132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:57.988407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:57.988680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] PATH_INFO: `/v3/users/c99e053a8aae42fbbc97115eac9f6c47` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:57.989955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99e053a8aae42fbbc97115eac9f6c47)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:57.991923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:58.199967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99e053a8aae42fbbc97115eac9f6c47'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:58.200633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99e053a8aae42fbbc97115eac9f6c47'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:58.201409 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99e053a8aae42fbbc97115eac9f6c47'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:58.208670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99e053a8aae42fbbc97115eac9f6c47'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:58.222284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99e053a8aae42fbbc97115eac9f6c47'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:58.397878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1228/2450] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 14:59:57 2022] DELETE /identity/v3/users/c99e053a8aae42fbbc97115eac9f6c47 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 14:59:58.402816 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:58.403341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:58.403776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:58.439834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 14:59:58.441107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:58.518972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1223/2451] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 14:59:58.528890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:58.530971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:58.703021 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:58.742186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff7ce-5ef2-4c7a-9a7e-52532bb4a1ab admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:58.747261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:58.747884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:58.748185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:58.748462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:58.758912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:58.760267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:58.772303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1229/2452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 14:59:58.778622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:59.151968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:59.403299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 14:59:59.621031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 14:59:59.623859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 14:59:59.636561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affa2eb-4f06-49bf-b810-e7054e3ebc1e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 14:59:59.646176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 14:59:59.646176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 14:59:59.646176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 14:59:59.646176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] PATH_INFO: `/v3/projects/abaae1678f8e47d7aa7a894683bb50e6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 14:59:59.650707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abaae1678f8e47d7aa7a894683bb50e6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 14:59:59.650707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 14:59:59.838434 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abaae1678f8e47d7aa7a894683bb50e6', 'request_id': 'req-60c94c2a-d973-48fa-b769-32ce7859d235'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:59.846842 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abaae1678f8e47d7aa7a894683bb50e6', 'request_id': 'req-60c94c2a-d973-48fa-b769-32ce7859d235'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:59.855259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abaae1678f8e47d7aa7a894683bb50e6', 'request_id': 'req-60c94c2a-d973-48fa-b769-32ce7859d235'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:59.958525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] The token cache is being invalidate because project abaae1678f8e47d7aa7a894683bb50e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 14:59:59.959120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:59.960165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-60c94c2a-d973-48fa-b769-32ce7859d235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 14:59:59.962740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1224/2453] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 14:59:59 2022] DELETE /identity/v3/projects/abaae1678f8e47d7aa7a894683bb50e6 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:00:00.350684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:00.472431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:01.062062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:01.323525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:01.421553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:01.431006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21ff33-d9ea-4269-b36a-5f1e7debd5b5 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:01.481685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:01.482367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:01.482564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:01.482837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:01.485212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:01.554942 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:01.556568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117e8b2-5e12-494a-a76c-0ebc5ec60459 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:01.566236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1230/2454] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:01.654883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:01.781341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:02.090104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:02.504492 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:02.755853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.078202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.117750 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.403145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.449081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.481438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.757494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:03.790093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.044085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.070098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.243259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.306749 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.329552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.466016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.541042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.729211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.830807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.882004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.924030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:04.975363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:05.107129 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:05.300381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:05.992281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:06.153191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:06.489167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:07.182361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:07.227286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:07.609326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:07.789013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:08.022426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:08.286310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:08.533296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:10.929317 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd144-1c48-4186-9f77-5427015be8a0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:10.929906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd144-1c48-4186-9f77-5427015be8a0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:10.930926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fd144-1c48-4186-9f77-5427015be8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:10.952970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-571fd144-1c48-4186-9f77-5427015be8a0 None None] MFA Rules not processed for user `e9e1efb821884a09a39371bc5b792a83`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:00:10.954174 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-571fd144-1c48-4186-9f77-5427015be8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:11.012993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1225/2455] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:00:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:00:13.885220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:13.885835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:13.885835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:13.912749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] MFA Rules not processed for user `7aef7a912bf8468283f4f420940cc639`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:00:13.912749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:13.962188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:13.976677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1231/2456] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:00:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:00:20.751479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:20.751479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:20.751479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:20.758923 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] MFA Rules not processed for user `91941658f2aa4a2a84c67a49fdfca8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:00:20.760304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:20.822833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1226/2457] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:00:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:00:24.283035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:30.815817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:44.762090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:44.763191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:44.776617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe41e8-0ee8-4020-b5c2-fc1321dc3b90 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:44.780291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:44.780914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:44.781214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:44.781485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:44.783466 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:44.863116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:44.864733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb85b7-43fc-46ab-97fa-81aea3bf6c33 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:44.878097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1232/2458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:49.559618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:49.561092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:49.625460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69e862-610c-47df-805b-ea97612d1d4c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:49.629146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:49.629758 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:49.630039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:49.630310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:49.632066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:49.645953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:49.647444 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:49.659128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1227/2459] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:00:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:00:54.871443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=34 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:00:56.305184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:56.305828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:56.305828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:56.326192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:00:56.327405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:56.384998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1233/2460] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 15:00:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:00:56.543711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:00:56.545164 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:00:56.617155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e7740-7e15-4339-9f16-391027190d64 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:00:56.622189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:00:56.622800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:00:56.623080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:00:56.623351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:00:56.633061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:00:56.634652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:00:56.643774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1228/2461] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 15:00:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 15:01:05.684151 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:05.686006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:05.759911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08d0ac-8dc6-4892-b2dc-8abd4b452928 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:05.764485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:05.765176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:05.765540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:05.765816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] PATH_INFO: `/v3/users/3e79e8dbf9b24efcbfbd2c1e6f47e5ee` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:05.767405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e79e8dbf9b24efcbfbd2c1e6f47e5ee)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:05.770874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:06.001469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e79e8dbf9b24efcbfbd2c1e6f47e5ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.002172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e79e8dbf9b24efcbfbd2c1e6f47e5ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.002791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e79e8dbf9b24efcbfbd2c1e6f47e5ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.010419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e79e8dbf9b24efcbfbd2c1e6f47e5ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.024910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e79e8dbf9b24efcbfbd2c1e6f47e5ee'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.129717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1234/2462] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:01:05 2022] DELETE /identity/v3/users/3e79e8dbf9b24efcbfbd2c1e6f47e5ee => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:06.639454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=58 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:06.662908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:06.677397 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e078e-588c-4ac6-87a0-00a796182c0b service swift] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:06.786582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:06.787260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:06.789047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:06.789047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] PATH_INFO: `/v3/projects/c971afe1aabd46888d53b253eac6c54d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:06.789047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c971afe1aabd46888d53b253eac6c54d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:06.791131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:06.924704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c971afe1aabd46888d53b253eac6c54d', 'request_id': 'req-61e694a7-01c2-4a21-9370-69598a432db7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.931346 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c971afe1aabd46888d53b253eac6c54d', 'request_id': 'req-61e694a7-01c2-4a21-9370-69598a432db7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:06.938034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c971afe1aabd46888d53b253eac6c54d', 'request_id': 'req-61e694a7-01c2-4a21-9370-69598a432db7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.042543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] The token cache is being invalidate because project c971afe1aabd46888d53b253eac6c54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:01:07.046849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.046849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.046849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1229/2463] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:01:06 2022] DELETE /identity/v3/projects/c971afe1aabd46888d53b253eac6c54d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:07.049921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:07.053954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:07.068367 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55b5c2-cece-49a3-81dd-2c171ae963b6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:07.098734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:07.146936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:07.147758 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:07.148139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:07.148506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] PATH_INFO: `/v3/users/f09c890abd954d0d8d27f389ab5c3a9e` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:07.149798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09c890abd954d0d8d27f389ab5c3a9e)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:07.152109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:07.419890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09c890abd954d0d8d27f389ab5c3a9e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.420563 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09c890abd954d0d8d27f389ab5c3a9e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.421214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09c890abd954d0d8d27f389ab5c3a9e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.433600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09c890abd954d0d8d27f389ab5c3a9e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.447019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09c890abd954d0d8d27f389ab5c3a9e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:07.531283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1235/2464] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:01:07 2022] DELETE /identity/v3/users/f09c890abd954d0d8d27f389ab5c3a9e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:01:07.828872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:07.830581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:07.845067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e694a7-01c2-4a21-9370-69598a432db7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:07.911075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:07.911729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:07.912003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:07.912332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] PATH_INFO: `/v3/projects/a232e9c171614c6f95f494271dfff84b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:07.913548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a232e9c171614c6f95f494271dfff84b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:07.915512 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:08.044832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:08.056325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a232e9c171614c6f95f494271dfff84b', 'request_id': 'req-38d40607-db15-4d1d-945e-a4c7c665b380'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:08.063791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a232e9c171614c6f95f494271dfff84b', 'request_id': 'req-38d40607-db15-4d1d-945e-a4c7c665b380'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:08.069602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a232e9c171614c6f95f494271dfff84b', 'request_id': 'req-38d40607-db15-4d1d-945e-a4c7c665b380'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:08.184993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] The token cache is being invalidate because project a232e9c171614c6f95f494271dfff84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:01:08.185483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:08.186051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:08.188490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1230/2465] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:01:07 2022] DELETE /identity/v3/projects/a232e9c171614c6f95f494271dfff84b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:09.409511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:09.410941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:09.495504 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f514e83-9fd6-48c6-b42f-1dea3842d741 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:09.536793 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:09.560188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:09.560828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:09.561106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:09.561374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:09.563264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:09.625520 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:09.627149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:09.637429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1236/2466] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:16.808383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:16.809972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:16.827255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d40607-db15-4d1d-945e-a4c7c665b380 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:16.832891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:16.833506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:16.833780 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:16.834048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:16.835827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:16.908810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:16.911803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:16.922640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1231/2467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:19.633122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=37 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:22.300858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:22.302482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:22.321004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefa240-2ade-4d90-b413-75f71c6c885a service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:22.333225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:22.334032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:22.334655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:22.335008 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:22.336946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:22.407902 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:22.409580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:22.420885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1237/2468] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:24.563652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:24.565224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:24.631823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650963-d46a-43de-9b58-f4fcbc63fd69 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:24.635505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:24.636135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:24.641892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:24.641892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:24.641892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:24.707385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:24.708903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:24.719763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1232/2469] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:28.934318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:28.935894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:28.952741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e8862d-b344-489c-9f0c-2d15cebe66d8 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:28.957568 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:28.958233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:28.958511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:28.958783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] PATH_INFO: `/v3/users/e9e1efb821884a09a39371bc5b792a83` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:28.959901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e1efb821884a09a39371bc5b792a83)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:28.961872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:29.209426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e1efb821884a09a39371bc5b792a83'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.210087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e1efb821884a09a39371bc5b792a83'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.210691 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e1efb821884a09a39371bc5b792a83'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.218713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e1efb821884a09a39371bc5b792a83'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.232035 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-0a7ee121-2855-4a56-b534-c560546aafbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e1efb821884a09a39371bc5b792a83'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.348843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1238/2470] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:01:28 2022] DELETE /identity/v3/users/e9e1efb821884a09a39371bc5b792a83 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:29.659094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:29.670649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbcb04-b2ea-46c2-9cb1-736e04d87a74 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:29.676674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:29.733049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:29.734304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:29.734703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:29.734978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] PATH_INFO: `/v3/projects/b2cca963208149f4af347a55588149d6` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:29.736127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2cca963208149f4af347a55588149d6)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:29.738103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:29.874239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2cca963208149f4af347a55588149d6', 'request_id': 'req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.880919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2cca963208149f4af347a55588149d6', 'request_id': 'req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:29.886506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2cca963208149f4af347a55588149d6', 'request_id': 'req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:30.002084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] The token cache is being invalidate because project b2cca963208149f4af347a55588149d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:01:30.002303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:30.002922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a4e429ec-c80d-4d6f-9c6f-6301fddf536e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:30.004440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1233/2471] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:01:29 2022] DELETE /identity/v3/projects/b2cca963208149f4af347a55588149d6 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:30.009675 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.010166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.010264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.030631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:30.032612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:30.094930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1239/2472] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:30.102809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.103091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.103362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.122912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:30.124271 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:30.132140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1234/2473] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:30.136357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.146602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d7a73-9a35-4ea0-8ddd-9dcd2c1a08fd None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.151080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.151673 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.151949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.152222 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.152880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:01:30.153175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.154756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.161930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:30.167067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1240/2474] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:01:30.171479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.180810 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8361de-9718-4e70-bc85-718cdc0d9d10 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.185566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.186656 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.186929 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.187194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.187980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.189972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.284084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1235/2475] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:01:30 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:01:30.288535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.300532 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacea91-c78f-408c-a7ce-073f2e1d2ac9 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.358819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.359429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.359705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.359974 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.360600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.362550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.486139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1241/2476] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:01:30 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:01:30.487023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.495325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7fd35-a345-4c8d-8b5d-d07f4890706f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.499985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.500587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.500898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.501166 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.501812 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.503557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.513792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1236/2477] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:01:30.518244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.528621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f4610-7132-45d8-b34e-96202cad7c77 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.533925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.534587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.534808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.535076 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.535718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.537391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3d1e-29f8-4137-a7dd-2994043df57f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.549753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1242/2478] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:01:30.553875 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.563801 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c57225-e096-457f-8ee5-5cdde126a149 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.568413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.569312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.569420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.569619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] PATH_INFO: `/v3/projects/431be6e9fe9b4d86a4e13bed3115c7ae/users/966455cdb80745098c98e78f76c2b60f/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.585939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=431be6e9fe9b4d86a4e13bed3115c7ae, user_id=966455cdb80745098c98e78f76c2b60f, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.588680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.682630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1237/2479] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:01:30 2022] PUT /identity/v3/projects/431be6e9fe9b4d86a4e13bed3115c7ae/users/966455cdb80745098c98e78f76c2b60f/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:30.687930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d83b2-b5c2-422c-a0de-c6c770be3ad0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.688344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d83b2-b5c2-422c-a0de-c6c770be3ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.688740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d83b2-b5c2-422c-a0de-c6c770be3ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.710211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a49d83b2-b5c2-422c-a0de-c6c770be3ad0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:30.711523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a49d83b2-b5c2-422c-a0de-c6c770be3ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:30.770849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1243/2480] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:01:30.781298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:30.783029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:30.823014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:30.840917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0a9f8-5316-4783-911f-fe870f99f19a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:30.845465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:30.846042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:30.846402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:30.846674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:30.856518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:30.858054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:30.869489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1238/2481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:36.966294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:36.966856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:36.966856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:37.001839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] MFA Rules not processed for user `966455cdb80745098c98e78f76c2b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:37.003094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:37.075905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1244/2482] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:37.090686 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:37.094747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:37.192546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18bae1b-d890-41ca-abca-a125053c278d service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:37.198789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:37.199455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:37.199692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:37.199967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:37.210048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:37.211908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:37.223559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1239/2483] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:38.962249 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:38.963736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:39.011167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5355d9f-a56e-4c48-8e81-4965c311300f None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:39.041659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:39.042631 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:39.044112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:39.046939 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:39.051221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:39.076587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:39.080063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:39.081957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748cd92-0df7-43d6-9a0b-cece2f62e823 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:39.136949 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1245/2484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:40.013549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:40.027001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28f2cf-3765-48b1-9aeb-eb4d59b6c8ab service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:40.040616 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:40.041364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:40.041629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:40.041897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:40.046321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:40.077650 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:40.079391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:40.107345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1240/2485] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:40.493884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a859-848b-4b77-999e-e8c0e644164e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:40.494431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a859-848b-4b77-999e-e8c0e644164e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:40.495490 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8a859-848b-4b77-999e-e8c0e644164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:40.531951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-14a8a859-848b-4b77-999e-e8c0e644164e None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:40.534123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-14a8a859-848b-4b77-999e-e8c0e644164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:40.615513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1246/2486] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 15:01:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:01:40.628219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:40.630339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:40.719415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864648-4408-46b0-890b-b6675a782b59 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:40.727085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:40.727986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:40.728463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:40.728935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:40.738760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:40.740471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:40.752471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1241/2487] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 15:01:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:01:41.066667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:41.067280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:41.067908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:41.090135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] MFA Rules not processed for user `966455cdb80745098c98e78f76c2b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:41.091841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:41.101234 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1247/2488] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:01:41.733500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:41.748696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0615f-b417-4e4a-99b5-17cce1001062 service swift] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:41.758587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:41.759729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:41.760256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:41.761325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:41.764256 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:41.794916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:41.798204 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:41.812374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1242/2489] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:42.516218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:42.521550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:42.671816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cceb45-66ff-4149-985c-a0daf20bab15 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:42.677131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:42.677791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:42.678070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:42.678344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:42.680277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:42.693783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:42.695396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:42.706994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1248/2490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:46.992285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:46.992285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:46.997729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bfcc0-9151-4605-bc09-d506efdf2307 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:47.002950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:47.003818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:47.004216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:47.004696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:47.007339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:47.031529 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:47.033027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:47.047722 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1243/2491] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:48.390418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:48.408477 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c539124-fd64-4f69-83ad-70d6341e78ec service placement] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:48.421503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:48.422411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:48.423554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:48.424011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:48.429549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:48.457665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:48.459616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:48.486268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1249/2492] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:53.442101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:53.443602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:53.465827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3af50-84bd-4c86-90e1-d9e1585936f8 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:53.476420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:53.477678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:53.478223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:53.478703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:53.480798 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:53.494714 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:53.496667 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:53.503569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:53.509888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1244/2493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:01:53.772095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:53.773415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:53.801655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d84d76-ee74-4b10-904f-b86b8798ad9d service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:53.806787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:53.807453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:53.807732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:53.808004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] PATH_INFO: `/v3/users/7aef7a912bf8468283f4f420940cc639` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:53.809213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aef7a912bf8468283f4f420940cc639)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:53.812083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:54.162677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aef7a912bf8468283f4f420940cc639'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:54.163710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aef7a912bf8468283f4f420940cc639'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:54.164316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aef7a912bf8468283f4f420940cc639'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:54.179436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aef7a912bf8468283f4f420940cc639'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:54.189135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:54.199615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8adcb8e3-9cd4-476b-84b6-e311a301de2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aef7a912bf8468283f4f420940cc639'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:54.479308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1250/2494] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:01:53 2022] DELETE /identity/v3/users/7aef7a912bf8468283f4f420940cc639 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:54.778349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:54.790195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f46914-3398-4959-96e2-b57ba65d9b4b service placement] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:54.849772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:54.850402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:54.850684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:54.850961 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] PATH_INFO: `/v3/projects/8011e151fe364f3abb906f9ead35cbad` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:54.852381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8011e151fe364f3abb906f9ead35cbad)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:54.854351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.023978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8011e151fe364f3abb906f9ead35cbad', 'request_id': 'req-97933992-7a9b-4ec5-a3fd-d79be5696ba6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:55.034286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8011e151fe364f3abb906f9ead35cbad', 'request_id': 'req-97933992-7a9b-4ec5-a3fd-d79be5696ba6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:55.040906 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8011e151fe364f3abb906f9ead35cbad', 'request_id': 'req-97933992-7a9b-4ec5-a3fd-d79be5696ba6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:55.153751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] The token cache is being invalidate because project 8011e151fe364f3abb906f9ead35cbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:01:55.162468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:55.162468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-97933992-7a9b-4ec5-a3fd-d79be5696ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:01:55.162468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1245/2495] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:01:54 2022] DELETE /identity/v3/projects/8011e151fe364f3abb906f9ead35cbad => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:55.162953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.162953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.162953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.183116 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:55.186870 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:55.274267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1251/2496] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:55.277055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.277401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.277676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.300313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:55.301607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:55.309830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1246/2497] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:55.314696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.324538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa6b6d-deb2-4cee-a743-de9deedbceda None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.329319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.329943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.330218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.330502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.331142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:01:55.331446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.333095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.347693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1252/2498] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:01:55.350533 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.361479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5f8dc7-f925-4151-9283-44814fbd7917 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.368027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.368944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.369285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.369540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.370188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.372176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.469168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1247/2499] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:01:55 2022] POST /identity/v3/projects => generated 407 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:01:55.474454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.488544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f16ac4-4c78-4135-9720-7bfbe66a9701 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.551157 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.551507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.551814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.552093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.552785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.554730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.683028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1253/2500] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:01:55 2022] POST /identity/v3/users => generated 304 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:01:55.688081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.698881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef720f-99cc-499c-a2d5-277f27e0c564 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.703723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.704462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.704637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.704902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.705551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.707169 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.718544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1248/2501] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:01:55.729533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.741034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631a031-bb44-4a12-9d6d-81e26c1dbf02 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.745723 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.746336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.746615 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.746897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.747531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.749224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb666e-714b-46d5-9b7b-e5bc6c4e58f6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.764071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1254/2502] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:01:55.768813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:55.779711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bbc90-cb8a-4c33-ab93-a5ecc740f838 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:55.784387 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:55.785151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.785500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.785840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] PATH_INFO: `/v3/projects/31dad84c7b9d46a98eff991c12a0476e/users/072060e18c814b899b4cfb413df38091/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.802696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] RBAC: Authorizing `identity:create_grant(project_id=31dad84c7b9d46a98eff991c12a0476e, user_id=072060e18c814b899b4cfb413df38091, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:55.805678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:55.947446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1249/2503] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:01:55 2022] PUT /identity/v3/projects/31dad84c7b9d46a98eff991c12a0476e/users/072060e18c814b899b4cfb413df38091/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:55.958688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:55.958970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:55.959241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:55.988187 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] MFA Rules not processed for user `072060e18c814b899b4cfb413df38091`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:55.989459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:56.036067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:56.074341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1255/2504] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:56.079141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.111715 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:56.144970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e8e6-e0a8-4457-a984-d8fa0a12072c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.149556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.150156 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.150436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.150710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.151341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.153281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.275471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1250/2505] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:01:56 2022] POST /identity/v3/projects => generated 407 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:01:56.280272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.291062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e463033-0f69-49a0-a05a-e6d489e21156 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.350283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.350901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.351180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.351454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.352350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.354315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.497027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1256/2506] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:01:56 2022] POST /identity/v3/users => generated 310 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:01:56.501233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.512259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a07f3e-177a-4b96-abcd-a0510c94386c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.517130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.517740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.518017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.518286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.518928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.520609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.531361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1251/2507] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:01:56.535692 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.546457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167de7f-8c89-41be-8339-948b62b905f8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.551362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.552080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.552361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.552629 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] PATH_INFO: `/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16/users/f12f93abd80a42caac9a07883eb9a9e4/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.568304 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e38fe1e2b1c4d0e9fcafde8604f2b16, user_id=f12f93abd80a42caac9a07883eb9a9e4, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.571126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.691633 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1257/2508] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:01:56 2022] PUT /identity/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16/users/f12f93abd80a42caac9a07883eb9a9e4/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:56.695941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.706342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738eecf-17e4-443a-94ae-92bb1ceeed07 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.775413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.776356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.777178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.777463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.778126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.780328 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3cdfb-f25d-4d25-9db4-a4a59e4c4a99 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.791631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1252/2509] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:01:56.796850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.807303 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f2c05-a6e9-4162-8039-4d31b5e023b6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:56.812584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:56.813355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.813719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.813994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] PATH_INFO: `/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16/users/f12f93abd80a42caac9a07883eb9a9e4/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.816048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e38fe1e2b1c4d0e9fcafde8604f2b16, user_id=f12f93abd80a42caac9a07883eb9a9e4, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:56.818834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:56.831038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1258/2510] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:01:56 2022] PUT /identity/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16/users/f12f93abd80a42caac9a07883eb9a9e4/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:01:56.849735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:56.849735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:56.849735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:56.874511 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] MFA Rules not processed for user `f12f93abd80a42caac9a07883eb9a9e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:01:56.875747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:56.963764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1253/2511] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:01:56 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:01:56.975538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:56.977573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:01:57.053871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce833e-7e01-43c2-b0d1-3fb559830eed admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:57.057733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:57.058414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:57.058774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:57.059104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:57.072747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:57.074189 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4104410-ffde-4ab4-905b-4e1817821935 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:57.090214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1259/2512] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:56 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:01:57.608863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:01:57.619632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923873e-218d-47cb-a1a5-d2470ba8754f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:01:57.625262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:01:57.625262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:01:57.625262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:01:57.625262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:01:57.645993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:01:57.687383 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:01:57.689036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ee0ad-6f52-4029-856a-49f7645420b7 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:01:57.700435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1254/2513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:01:57 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:02:01.461791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:01.462228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:01.462319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:01.463627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1260/2514] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 15:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:02:01.471480 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796265b-0114-4494-af36-ef0d6e34f58d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:01.472045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796265b-0114-4494-af36-ef0d6e34f58d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:01.472045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796265b-0114-4494-af36-ef0d6e34f58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:01.493772 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-5796265b-0114-4494-af36-ef0d6e34f58d None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:01.499483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5796265b-0114-4494-af36-ef0d6e34f58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:01.587605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1255/2515] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 15:02:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:01.601310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:01.603936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:01.645601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:01.679618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a245d-59fc-4c8f-b012-a98ce76dfed3 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:01.683584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:01.684288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:01.684570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:01.685583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:01.701966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:01.707136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f063e-5f95-4bd9-b9a4-cdab4339b1d1 service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:01.715254 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1261/2516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:02.119994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:02.120278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:02.120546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] PATH_INFO: `/` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:02.122122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1256/2517] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 15:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 15:02:02.127835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fa677-388f-47e2-a057-0fd6f3418e6e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:02.128160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fa677-388f-47e2-a057-0fd6f3418e6e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:02.128483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9fa677-388f-47e2-a057-0fd6f3418e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:02.155749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9b9fa677-388f-47e2-a057-0fd6f3418e6e None None] MFA Rules not processed for user `aff851a161644ee0b97c18d2c30dc5a7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:02.157022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9b9fa677-388f-47e2-a057-0fd6f3418e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:02.211123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1262/2518] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 15:02:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:02.223369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:02.225147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:02.239767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf87bf-059b-4239-967a-e2a2babeb43b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:02.243542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:02.244140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:02.244419 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:02.244687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:02.253080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:02.254853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:02.265689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1257/2519] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:05.338263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:05.338771 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:05.338866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:05.358476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:05.359661 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:05.417961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1263/2520] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 24 15:02:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:05.439774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:05.441392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:05.511436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32022e-6191-4b8d-8c3f-d3881e640f99 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:05.516685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:05.517324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:05.517607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:05.517881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:05.526292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:05.527863 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d14f0e-6c5c-4403-84fc-7a32f0bf0321 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:05.536783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1258/2521] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 15:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:02:05.718436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:05.845632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef423ae-6f90-4a9a-b435-ee08ab063f5c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:05.856082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:05.857649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:05.858594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:05.859414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] PATH_INFO: `/v3/users/072060e18c814b899b4cfb413df38091` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:05.862056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=072060e18c814b899b4cfb413df38091)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:05.866191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:06.147440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:06.165588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '072060e18c814b899b4cfb413df38091'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:06.166570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '072060e18c814b899b4cfb413df38091'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:06.167370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '072060e18c814b899b4cfb413df38091'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:06.178632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '072060e18c814b899b4cfb413df38091'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:06.219925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '072060e18c814b899b4cfb413df38091'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:06.316092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1264/2522] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:05 2022] DELETE /identity/v3/users/072060e18c814b899b4cfb413df38091 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:06.320874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:06.321170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:06.321443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:06.344358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:06.345697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:06.383411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:06.425040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1259/2523] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:06.436344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:06.438323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:06.519935 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e038d-ac23-4b33-badf-4a0feb619ff8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:06.523708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:06.524325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:06.524611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:06.524901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:06.535274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:06.537612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:06.556546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1265/2524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:02:07.135443 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:07.135885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:07.152566 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b917a3-a43a-4ad1-a93b-1695e9752a2b None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:07.157796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:07.158570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:07.158954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:07.159325 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] PATH_INFO: `/v3/projects/31dad84c7b9d46a98eff991c12a0476e` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:07.161253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31dad84c7b9d46a98eff991c12a0476e)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:07.163679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:07.324876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31dad84c7b9d46a98eff991c12a0476e', 'request_id': 'req-044205e3-276e-4cef-b62b-99ee5100b5d6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.333069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31dad84c7b9d46a98eff991c12a0476e', 'request_id': 'req-044205e3-276e-4cef-b62b-99ee5100b5d6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.340337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31dad84c7b9d46a98eff991c12a0476e', 'request_id': 'req-044205e3-276e-4cef-b62b-99ee5100b5d6'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.470355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] The token cache is being invalidate because project 31dad84c7b9d46a98eff991c12a0476e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:07.470662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.471531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.478627 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:07.479378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1260/2525] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:07 2022] DELETE /identity/v3/projects/31dad84c7b9d46a98eff991c12a0476e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:07.500678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4ec55-3352-4f80-9c22-3818169ea265 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:07.573846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:07.574405 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:07.574685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:07.574963 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] PATH_INFO: `/v3/users/f12f93abd80a42caac9a07883eb9a9e4` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:07.576305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12f93abd80a42caac9a07883eb9a9e4)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:07.578287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:07.827920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12f93abd80a42caac9a07883eb9a9e4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.828518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12f93abd80a42caac9a07883eb9a9e4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.829166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12f93abd80a42caac9a07883eb9a9e4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.834831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:07.838658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12f93abd80a42caac9a07883eb9a9e4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.853316 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-81bf6d35-742b-4214-b3d2-b578ef21f9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12f93abd80a42caac9a07883eb9a9e4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:07.948862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1266/2526] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:07 2022] DELETE /identity/v3/users/f12f93abd80a42caac9a07883eb9a9e4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:08.650159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:08.652335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:08.684260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044205e3-276e-4cef-b62b-99ee5100b5d6 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:08.786367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:08.786928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:08.787203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:08.787475 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] PATH_INFO: `/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:08.788820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e38fe1e2b1c4d0e9fcafde8604f2b16)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:08.790991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:08.948246 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e38fe1e2b1c4d0e9fcafde8604f2b16', 'request_id': 'req-05284e9b-b707-4c5e-a91a-516a74e1f640'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:08.956415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e38fe1e2b1c4d0e9fcafde8604f2b16', 'request_id': 'req-05284e9b-b707-4c5e-a91a-516a74e1f640'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:08.958088 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:08.963865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e38fe1e2b1c4d0e9fcafde8604f2b16', 'request_id': 'req-05284e9b-b707-4c5e-a91a-516a74e1f640'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:09.108787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] The token cache is being invalidate because project 8e38fe1e2b1c4d0e9fcafde8604f2b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:09.109101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:09.109847 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-05284e9b-b707-4c5e-a91a-516a74e1f640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:09.111418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1261/2527] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:08 2022] DELETE /identity/v3/projects/8e38fe1e2b1c4d0e9fcafde8604f2b16 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:02:09.116724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.118620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.119215 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.142258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:09.143494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:09.244334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.245039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.247783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.248056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1267/2528] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:09.285992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:09.288329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:09.301683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1262/2529] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:09.306431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:09.323787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3eecb7-bd97-4350-9f30-a95c2e2e2348 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:09.323787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:09.323787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.323787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.324267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.324267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:02:09.324427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:09.327556 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:09.342284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1268/2530] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:02:09.346861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:09.359694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d6b75-f987-4e66-9c4e-3db9d6f89af2 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:09.366774 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:09.367949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.368231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.368505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.372763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:09.372763 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:09.576409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1263/2531] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:02:09 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:09.597584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:09.612325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fc27-cdcc-4ec8-9073-3be9f006124e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:09.716440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:09.717601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.718123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.718614 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.719476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:09.722358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:09.828231 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1269/2532] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:02:09 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:09.832089 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:09.851138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ab857-2501-47a1-8826-40db2a2cfaf7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:09.856469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:09.858049 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.858331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.858604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.859258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:09.861167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:09.888061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1264/2533] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:02:09.892144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:09.922853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa97142-8db6-49da-ba8b-f22de9a15fab admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:09.940622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:09.942228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:09.942736 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:09.943435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:09.944401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:09.949687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e69e5d0-3cc6-4bda-9bd5-422267f8ae78 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:09.982282 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1270/2534] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:02:09.986883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:10.009785 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bf816-68f5-44b8-be27-802b42231029 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:10.015541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:10.016234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:10.016518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:10.016840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] PATH_INFO: `/v3/projects/63b150bf1d9e4e888d016dea2e1e6a59/users/5df80db5be374dc6a0f62f3e89b09e75/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:10.055402 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b150bf1d9e4e888d016dea2e1e6a59, user_id=5df80db5be374dc6a0f62f3e89b09e75, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:10.058464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:10.134004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1265/2535] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:02:09 2022] PUT /identity/v3/projects/63b150bf1d9e4e888d016dea2e1e6a59/users/5df80db5be374dc6a0f62f3e89b09e75/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:10.145434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448ba6-c75a-4241-bec7-a9b30b7de82f None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:10.146278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448ba6-c75a-4241-bec7-a9b30b7de82f None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:10.146278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448ba6-c75a-4241-bec7-a9b30b7de82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:10.188092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6b448ba6-c75a-4241-bec7-a9b30b7de82f None None] MFA Rules not processed for user `5df80db5be374dc6a0f62f3e89b09e75`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:10.189351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6b448ba6-c75a-4241-bec7-a9b30b7de82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:10.216460 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:10.261263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1271/2536] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:02:10.275023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:10.276858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:10.371010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7ad9-57df-4168-b760-4d8eb0bfc970 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:10.375332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:10.375916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:10.376201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:10.376638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:10.386415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:10.388525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:10.408896 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1266/2537] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:20.377238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=16 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:20.394992 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=3,keystone:SELECT=57,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:22.326988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:22.332090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:22.332090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:22.350773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] MFA Rules not processed for user `4f381185bbee4e77aaeec0379d1b8a56`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:22.352344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:22.413724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1272/2538] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 24 15:02:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:22.427817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:22.429304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:22.500401 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a2472-bd23-4031-8cda-933df1e3a8a5 service glance] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:22.505517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3fb72c42601649fe866653918ccbb6fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:22.506131 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:22.506411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:22.506685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:22.515619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:22.517693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3a1d7-3061-4795-886c-bca7d895c4a2 service swift] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:22.525846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1267/2539] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 24 15:02:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 15:02:28.613830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:28.703150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de95ff-7c56-4fc8-ab39-f572150d8727 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:28.707863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:28.708518 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:28.708833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:28.709149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] PATH_INFO: `/v3/users/5df80db5be374dc6a0f62f3e89b09e75` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:28.710378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df80db5be374dc6a0f62f3e89b09e75)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:28.712368 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:28.947707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df80db5be374dc6a0f62f3e89b09e75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:28.948434 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df80db5be374dc6a0f62f3e89b09e75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:28.961057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df80db5be374dc6a0f62f3e89b09e75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:28.961057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df80db5be374dc6a0f62f3e89b09e75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:28.970412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df80db5be374dc6a0f62f3e89b09e75'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:29.111358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1273/2540] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:28 2022] DELETE /identity/v3/users/5df80db5be374dc6a0f62f3e89b09e75 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:29.115944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:29.116461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:29.116461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:29.137821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:29.139099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:29.203674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1268/2541] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:29.214784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:29.216379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:29.246341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:29.277579 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c5d91-6676-4372-acde-7bdeddd94b32 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:29.281601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:29.282221 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:29.282542 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:29.283230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:29.292725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:29.294984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846155ac-b391-4412-b947-0500a92e5590 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:29.305642 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1274/2542] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:29.806062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:29.807513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:29.820786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09875c4-c1bc-4d6f-89a4-7ced03f3eb90 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:29.827727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:29.828585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:29.828907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:29.829187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] PATH_INFO: `/v3/projects/63b150bf1d9e4e888d016dea2e1e6a59` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:29.830415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b150bf1d9e4e888d016dea2e1e6a59)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:29.833617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:29.977218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b150bf1d9e4e888d016dea2e1e6a59', 'request_id': 'req-1d79040a-d272-4160-ab9b-2509381e06a5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:29.984742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b150bf1d9e4e888d016dea2e1e6a59', 'request_id': 'req-1d79040a-d272-4160-ab9b-2509381e06a5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:29.991796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b150bf1d9e4e888d016dea2e1e6a59', 'request_id': 'req-1d79040a-d272-4160-ab9b-2509381e06a5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:30.140691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] The token cache is being invalidate because project 63b150bf1d9e4e888d016dea2e1e6a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:30.141423 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:30.141721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d79040a-d272-4160-ab9b-2509381e06a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:30.143292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1269/2543] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:29 2022] DELETE /identity/v3/projects/63b150bf1d9e4e888d016dea2e1e6a59 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:30.148350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.148878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.148999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.169991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:30.171196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:30.244509 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1275/2544] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:02:30.253835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15059a-9904-4857-95f0-f60078790359 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.254123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15059a-9904-4857-95f0-f60078790359 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.254399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee15059a-9904-4857-95f0-f60078790359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.276841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ee15059a-9904-4857-95f0-f60078790359 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:30.278135 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee15059a-9904-4857-95f0-f60078790359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:30.286637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1270/2545] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:30.291326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.301668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02768e6b-f202-4569-9f73-f7b3ebe1070b None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.306398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.306996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.307271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.307541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.308184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:02:30.308480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.310651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.322599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1276/2546] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:02:30.328124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15059a-9904-4857-95f0-f60078790359 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.338004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee15059a-9904-4857-95f0-f60078790359 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.343221 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.343848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.344195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.344546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.345284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.347334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.352429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:30.489534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1271/2547] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:02:30 2022] POST /identity/v3/projects => generated 359 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:30.493908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.505286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94212-b89a-4e81-92ed-4f3183a2e7de admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.566192 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.566802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.567092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.567336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.567993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.569994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.716674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1277/2548] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:02:30 2022] POST /identity/v3/users => generated 280 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:30.721493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.734078 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef521274-c364-4bca-936e-4b0580edb7f1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.738845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.739449 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.739727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.740138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.740871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.742530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.767013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1272/2549] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:02:30.771325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.781831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad42e1-482f-4c23-85b6-341d010756c5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.786751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.787364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.787639 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.787909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.788580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.790346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1b878-b4a6-4d3f-bd40-90566f810a42 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.805464 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1278/2550] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:02:30.806433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.818180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c130e53-ce06-4e6f-8868-96ace8af31a5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:30.823079 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:30.823747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.824026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.824329 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] PATH_INFO: `/v3/projects/82e649a2987b40e7a57da74b02b8d5ad/users/166031297d954d6dba839ceadd02b73e/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.832676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01955-a451-4f5c-9f6b-1949376582ff None None] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.833034 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01955-a451-4f5c-9f6b-1949376582ff None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.833366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d01955-a451-4f5c-9f6b-1949376582ff None None] PATH_INFO: `/` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.834727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1279/2551] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 24 15:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 15:02:30.840131 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:30.840437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:30.849728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:30.849868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e649a2987b40e7a57da74b02b8d5ad, user_id=166031297d954d6dba839ceadd02b73e, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:30.849868 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34425a7a-0492-4083-ab4a-2abc7ab11d46 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:30.864895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] MFA Rules not processed for user `0354722e40a344e9b2196bfa7b3e00e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:30.866130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:30.899483 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:30.944141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1280/2552] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 24 15:02:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:02:30.954982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:30.956320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:30.992959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1273/2553] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:02:30 2022] PUT /identity/v3/projects/82e649a2987b40e7a57da74b02b8d5ad/users/166031297d954d6dba839ceadd02b73e/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:02:31.003435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.003726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.004008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.013571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e71a96-12dc-447b-9856-ff515e53a469 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:31.034789 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] MFA Rules not processed for user `166031297d954d6dba839ceadd02b73e`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:31.036013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:31.065298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:31.065907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.066185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.066457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.103610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1274/2554] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:02:31.137640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:31.137884 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:31.139229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:31.139374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:31.150975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1281/2555] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:02:31.196800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33434d27-4d73-4fd5-94d7-87f7cd3ac0b9 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:31.200436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:31.201262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.201375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.201610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.210871 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:31.212334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3872250-1480-4ddc-8de4-406d71942033 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:31.222157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1275/2556] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:02:31.238535 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:31.263528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:31.305476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3e8f8a-5f89-4255-8cb6-dac14125bbd5 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:31.310955 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:31.311274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.311551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.311821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] PATH_INFO: `/v3/users/166031297d954d6dba839ceadd02b73e` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.313009 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166031297d954d6dba839ceadd02b73e)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:31.315090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:31.552604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166031297d954d6dba839ceadd02b73e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:31.553319 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166031297d954d6dba839ceadd02b73e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:31.553929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166031297d954d6dba839ceadd02b73e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:31.561159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166031297d954d6dba839ceadd02b73e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:31.579993 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166031297d954d6dba839ceadd02b73e'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:31.692274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1282/2557] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:02:31 2022] DELETE /identity/v3/users/166031297d954d6dba839ceadd02b73e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:02:31.697188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.697471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.697740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.717303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:31.718510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:31.757463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:31.785872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1276/2558] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:31.792204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:31.794111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:31.864277 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a78107-5e36-4079-a73a-1d1116c41d11 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:31.867947 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:31.868702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:31.869023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:31.869289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:31.880748 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:31.882283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e723-922c-438f-9bea-71876bee846b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:31.894461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1283/2559] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:32.499727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:32.501420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:32.515781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6999b2-9e28-4ebe-a022-b26f333e2026 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:32.520356 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:32.521707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:32.522004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:32.522366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] PATH_INFO: `/v3/projects/82e649a2987b40e7a57da74b02b8d5ad` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:32.523412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e649a2987b40e7a57da74b02b8d5ad)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:32.525901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:32.647800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e649a2987b40e7a57da74b02b8d5ad', 'request_id': 'req-17aefb42-eb71-4e3e-977e-2ffbf6881613'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:32.655849 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e649a2987b40e7a57da74b02b8d5ad', 'request_id': 'req-17aefb42-eb71-4e3e-977e-2ffbf6881613'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:32.661837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e649a2987b40e7a57da74b02b8d5ad', 'request_id': 'req-17aefb42-eb71-4e3e-977e-2ffbf6881613'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:32.784458 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] The token cache is being invalidate because project 82e649a2987b40e7a57da74b02b8d5ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:02:32.784679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:32.785562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-17aefb42-eb71-4e3e-977e-2ffbf6881613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:02:32.787055 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1277/2560] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:02:32 2022] DELETE /identity/v3/projects/82e649a2987b40e7a57da74b02b8d5ad => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:02:32.792101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:32.792577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:32.792841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:32.813201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:32.814414 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:32.857718 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:32.876341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1284/2561] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:32.885277 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:32.885557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:32.885829 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:32.906446 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:32.907652 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:32.915547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1278/2562] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:32.919996 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:32.933458 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf7efc-8665-4c3b-b96a-713a9316e397 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:32.941265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:32.945359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:32.945359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:32.945359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:32.945359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:02:32.945359 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:32.945847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:32.957674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1285/2563] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:02:32.962109 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:32.972155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3da51a-de89-41e4-8431-9169556bdb98 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:32.977412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:32.979744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:32.979744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:32.979744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:32.979744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:32.981323 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.103994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1279/2564] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:02:32 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:33.104213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:33.108315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2bdb1-ab15-4428-8c13-05882ed0445d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:33.168036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:33.168679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.169259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.169443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.170113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:33.172114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.348555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1286/2565] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:02:33 2022] POST /identity/v3/users => generated 285 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:02:33.349890 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:33.361456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05b603-fdba-4eb6-9bbf-e974f4d5857e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:33.367912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:33.368515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.368832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.369101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.369975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:33.372250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.390471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1280/2566] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:02:33.394342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:33.405332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbabaa0-7e6f-43bc-bc1e-d4a02b654085 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:33.410253 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:33.410868 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.411149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.411425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.412078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:33.413715 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cb3724-77bb-4761-955a-f234db13fcc1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.425080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1287/2567] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:02:33.429545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:33.440572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbab68-9402-4dc6-944e-469e71ae90bb admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:33.445209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:33.445864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.446140 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.447764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] PATH_INFO: `/v3/projects/f1501dfb390e4044a1ce3d30acfb4169/users/5789156e46fd47289e624f17c618b8b2/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.462862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1501dfb390e4044a1ce3d30acfb4169, user_id=5789156e46fd47289e624f17c618b8b2, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:33.465711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.618782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1281/2568] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:02:33 2022] PUT /identity/v3/projects/f1501dfb390e4044a1ce3d30acfb4169/users/5789156e46fd47289e624f17c618b8b2/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:02:33.630024 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a174ef-19e8-43dc-874e-65561b3269b8 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.630479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a174ef-19e8-43dc-874e-65561b3269b8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.630752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a174ef-19e8-43dc-874e-65561b3269b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.657828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d3a174ef-19e8-43dc-874e-65561b3269b8 None None] MFA Rules not processed for user `5789156e46fd47289e624f17c618b8b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:33.659191 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d3a174ef-19e8-43dc-874e-65561b3269b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:33.728179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1288/2569] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:02:33.740000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:33.741787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:33.801865 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a01e4-2040-4bd8-9c27-e7a59f692fc7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:33.805602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:33.817644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:33.817644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:33.817644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:33.817644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:33.818223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:33.827959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1282/2570] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:43.724944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:43.823087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:46.316674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:46.317257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:46.317257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:46.340487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] MFA Rules not processed for user `966455cdb80745098c98e78f76c2b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:02:46.340487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:46.395817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1289/2571] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:02:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:02:46.712514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:02:46.725734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:46.779399 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed2fb11-30fb-47a4-b8ce-35208db0be91 service glance] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:02:46.783119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:02:46.783710 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:02:46.783986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:02:46.784266 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:02:46.785979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:02:46.795604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:02:46.797107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:02:46.805025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1283/2572] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:02:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:02:56.389171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=25 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:02:56.801450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=26 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:02.668559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:02.670080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:02.757223 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d4043-3301-4b53-a024-a9575482f0c9 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:02.764029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:02.764649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:02.764957 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:02.765226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:02.766970 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:02.779447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:02.781081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b432f1ea-0460-4745-bc0b-b6e0440f33eb service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:02.792086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1290/2573] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:04.084112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:04.147716 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fafb9-f4d1-44df-be5d-25e41d0d4b6b service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:04.152703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:04.157605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:04.157605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:04.157605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] PATH_INFO: `/v3/users/5789156e46fd47289e624f17c618b8b2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:04.157605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5789156e46fd47289e624f17c618b8b2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:04.157605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:04.767363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5789156e46fd47289e624f17c618b8b2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:04.768014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5789156e46fd47289e624f17c618b8b2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:04.768613 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5789156e46fd47289e624f17c618b8b2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:05.052275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5789156e46fd47289e624f17c618b8b2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:05.060534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5789156e46fd47289e624f17c618b8b2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:05.080380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1284/2574] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:04 2022] DELETE /identity/v3/users/5789156e46fd47289e624f17c618b8b2 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:05.085245 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:05.085767 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:05.085867 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:05.106698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:05.108196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:05.168872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1291/2575] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:05.178937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:05.180384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:05.242370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad601120-9ce0-41f9-b233-9f832fab19d4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:05.246052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:05.246653 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:05.246921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:05.247191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:05.255955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:05.257422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2298891-c8e9-40e8-9752-5fe867b21aea service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:05.267263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1285/2576] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:06.082785 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:06.084495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:06.098578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f77056-5a8d-4b78-8091-552390eaf6ca None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:06.104700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:06.105891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:06.106257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:06.106571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] PATH_INFO: `/v3/projects/f1501dfb390e4044a1ce3d30acfb4169` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:06.107734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1501dfb390e4044a1ce3d30acfb4169)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:06.109703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:06.380571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1501dfb390e4044a1ce3d30acfb4169', 'request_id': 'req-5c1412cc-e04f-419a-a1c6-444640144b6f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:06.576244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1501dfb390e4044a1ce3d30acfb4169', 'request_id': 'req-5c1412cc-e04f-419a-a1c6-444640144b6f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:06.582791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1501dfb390e4044a1ce3d30acfb4169', 'request_id': 'req-5c1412cc-e04f-419a-a1c6-444640144b6f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:06.594670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] The token cache is being invalidate because project f1501dfb390e4044a1ce3d30acfb4169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:06.595070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:06.595714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5c1412cc-e04f-419a-a1c6-444640144b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:06.597227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1292/2577] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:06 2022] DELETE /identity/v3/projects/f1501dfb390e4044a1ce3d30acfb4169 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:06.602160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:06.602873 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:06.602981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:06.623008 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:06.624691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:06.643565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:06.706854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1286/2578] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:06.708560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:06.708850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:06.713127 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:06.733077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:06.735377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:06.744819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1293/2579] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:06.749376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:06.759456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90d9dc-cc95-4355-b978-cbb8ffe1704f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:06.776424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:06.776424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:06.776424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:06.776424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:06.777002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:03:06.777002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:06.777002 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:06.784910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1287/2580] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:03:06.785995 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:06.790907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:06.811725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a7962-9140-47cd-bd68-e31fd90abcdc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:06.811725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:06.811725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:06.811725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:06.812067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:06.812067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:06.812067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.049297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1294/2581] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:06 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:03:07.060981 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:07.065636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb28ca70-7393-4b8f-9c6c-c8b4a46da139 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:07.133272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:07.134324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.134741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.135010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.135745 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:07.138964 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.353455 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1288/2582] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:07 2022] POST /identity/v3/users => generated 286 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:07.358645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:07.368964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78f9e2-ba86-4c4e-b849-dff16744a648 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:07.374668 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:07.375360 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.377068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.377068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.377068 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:07.378517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.391090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1295/2583] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:07.395491 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:07.406468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942bda-21a7-4cca-a79c-2d4b8b76634f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:07.411358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:07.412587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.412587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.412854 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.413721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:07.416760 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5f7c7-5ebf-48ef-acdc-6674f370ff7b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.429005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1289/2584] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:03:07.434019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:07.444159 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b755-5149-4aed-8fb1-2166c0ca03dd admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:07.449137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:07.450066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.450397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.450679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] PATH_INFO: `/v3/projects/1787b457eeb844f484c8b7b810176f0c/users/b78931dec878473eb6200e3bf822b51c/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.468481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1787b457eeb844f484c8b7b810176f0c, user_id=b78931dec878473eb6200e3bf822b51c, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:07.470216 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.632603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1296/2585] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:07 2022] PUT /identity/v3/projects/1787b457eeb844f484c8b7b810176f0c/users/b78931dec878473eb6200e3bf822b51c/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:07.635600 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.636092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.636189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.666046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] MFA Rules not processed for user `b78931dec878473eb6200e3bf822b51c`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:07.667189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:07.734068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1290/2586] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:07.746362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:07.748142 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:07.810804 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c73e7f-71ce-4fbc-9c97-3274cb592ed2 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:07.814601 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae76bbd0c6b34ed996bc76c1f4a00e27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:07.815211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:07.815488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:07.815759 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:07.826548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:07.827984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:07.849421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1297/2587] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:03:12.955983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:12.957424 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:12.981790 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:13.022127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57855a9-bb77-4fd3-bbf5-0d0edcf398d4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:13.027596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:13.028507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:13.029379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:13.030026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:13.032113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:13.098813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:13.100296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:13.111459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1291/2588] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:17.357468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:17.357468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:17.374146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96c60-36ed-4b53-95f8-bce4474b7b26 service glance] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:17.379507 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:17.386472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:17.386472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:17.386472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] PATH_INFO: `/v3/users/91941658f2aa4a2a84c67a49fdfca8f5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:17.386472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91941658f2aa4a2a84c67a49fdfca8f5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:17.386472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:17.643248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91941658f2aa4a2a84c67a49fdfca8f5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:17.643907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91941658f2aa4a2a84c67a49fdfca8f5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:17.644516 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91941658f2aa4a2a84c67a49fdfca8f5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:17.653038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91941658f2aa4a2a84c67a49fdfca8f5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:17.669052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c66f3a16-39c3-46c5-931b-a2bf01d50917 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91941658f2aa4a2a84c67a49fdfca8f5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:17.789033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1298/2589] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:17 2022] DELETE /identity/v3/users/91941658f2aa4a2a84c67a49fdfca8f5 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:18.154910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:18.166081 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a67568-fca0-44d1-b8e2-ee158b6cd6b7 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:18.229194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:18.230335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.230335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.230567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] PATH_INFO: `/v3/projects/49e76523fb464226a537bbfd6b419b3b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.231628 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e76523fb464226a537bbfd6b419b3b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:18.233601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:18.356797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e76523fb464226a537bbfd6b419b3b', 'request_id': 'req-f188745e-3404-4f17-8fb4-213a38c19cf4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:18.365023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e76523fb464226a537bbfd6b419b3b', 'request_id': 'req-f188745e-3404-4f17-8fb4-213a38c19cf4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:18.371218 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e76523fb464226a537bbfd6b419b3b', 'request_id': 'req-f188745e-3404-4f17-8fb4-213a38c19cf4'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:18.481899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:18.486664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] The token cache is being invalidate because project 49e76523fb464226a537bbfd6b419b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:18.487029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:18.487663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-f188745e-3404-4f17-8fb4-213a38c19cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:18.489192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1292/2590] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:18 2022] DELETE /identity/v3/projects/49e76523fb464226a537bbfd6b419b3b => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:18.494101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.501315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.501315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.515350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:18.516574 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:18.530099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:18.577005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1299/2591] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:18.585669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.585950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.586220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.606797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:18.608033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:18.616286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1293/2592] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:18.621265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:18.631364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b93e-03ac-4103-9d24-adca7b399838 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:18.636117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:18.636951 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.637232 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.637508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.638168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:03:18.638474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:18.640118 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:18.652871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1300/2593] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:03:18.657504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:18.667828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47964b-a359-41df-8da1-a845ab68407c None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:18.673170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:18.673930 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.674212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.674601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.675358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:18.677615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:18.785558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1294/2594] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:18 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:18.789772 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:18.800217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cc708-62bf-4689-a707-86519a958b30 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:18.857950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:18.858566 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:18.858845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:18.859114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:18.859790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:18.861821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:19.023858 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1301/2595] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:18 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:19.028581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:19.038900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3bb5e-7abe-40d9-a215-179b1e3987da admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:19.044199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:19.044809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:19.045093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:19.045361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:19.045999 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:19.047592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:19.057932 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1295/2596] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:03:19.070648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:19.080861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ea1dc-a710-4780-8ee4-80eec84b771d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:19.085741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:19.086334 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:19.086613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:19.086884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:19.087652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:19.089819 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c80ae-2959-4d69-9f5e-e83e0a2bf106 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:19.101999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1302/2597] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:19.107691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:19.118761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9665c73-c79f-4736-a9d8-4969f391b540 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:19.123583 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:19.124234 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:19.124514 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:19.124844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] PATH_INFO: `/v3/projects/d8b1e9304cd3404abd23d01e26e3386f/users/acc063684852410daaaec6a7b8367c99/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:19.140595 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b1e9304cd3404abd23d01e26e3386f, user_id=acc063684852410daaaec6a7b8367c99, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:19.143318 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:19.247067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1296/2598] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:19 2022] PUT /identity/v3/projects/d8b1e9304cd3404abd23d01e26e3386f/users/acc063684852410daaaec6a7b8367c99/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:03:19.257362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:19.262279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:19.262279 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:19.289128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] MFA Rules not processed for user `acc063684852410daaaec6a7b8367c99`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:19.290372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:19.358242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1303/2599] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:19.369761 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:19.371507 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:19.444674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03d138-5feb-4cf6-acc3-e378c5024101 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:19.450775 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:19.451405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:19.451681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:19.451948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:19.459625 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:19.461241 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb63f41-3a0c-4493-8ad8-524b40bb055e service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:19.470680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1297/2600] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:03:22.861525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:22.879808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:22.927276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21b7ab-3260-4205-9111-52c20f761e45 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:22.931964 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:22.932600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:22.932980 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:22.933442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] PATH_INFO: `/v3/users/acc063684852410daaaec6a7b8367c99` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:22.934635 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc063684852410daaaec6a7b8367c99)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:22.936539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:23.158085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc063684852410daaaec6a7b8367c99'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:23.158756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc063684852410daaaec6a7b8367c99'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:23.159380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc063684852410daaaec6a7b8367c99'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:23.166787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc063684852410daaaec6a7b8367c99'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:23.179396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc063684852410daaaec6a7b8367c99'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:23.313506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1304/2601] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:22 2022] DELETE /identity/v3/users/acc063684852410daaaec6a7b8367c99 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:23.322021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:23.322791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:23.322791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:23.342950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:23.344200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:23.412726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1298/2602] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:23.429851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:23.431411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:23.490336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e5f0-d62f-4a3e-81b2-8d1a380e4d85 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:23.494095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:23.494704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:23.494982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:23.495775 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:23.504965 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:23.506398 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2051-ab93-4cb9-bf16-bd4b6f945094 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:23.516688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1305/2603] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:24.031116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.032594 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:24.046027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc8791-4414-4365-ab2d-1436a96cfcdd None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.050690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.051519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.051802 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.052073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] PATH_INFO: `/v3/projects/d8b1e9304cd3404abd23d01e26e3386f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.053245 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b1e9304cd3404abd23d01e26e3386f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.067662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:24.072646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:24.212922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b1e9304cd3404abd23d01e26e3386f', 'request_id': 'req-ae8f401f-d19f-478b-8201-e4b335fa559f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:24.220193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b1e9304cd3404abd23d01e26e3386f', 'request_id': 'req-ae8f401f-d19f-478b-8201-e4b335fa559f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:24.225943 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b1e9304cd3404abd23d01e26e3386f', 'request_id': 'req-ae8f401f-d19f-478b-8201-e4b335fa559f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:24.366206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] The token cache is being invalidate because project d8b1e9304cd3404abd23d01e26e3386f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:24.366919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:24.367120 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ae8f401f-d19f-478b-8201-e4b335fa559f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:24.371928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1299/2604] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:24 2022] DELETE /identity/v3/projects/d8b1e9304cd3404abd23d01e26e3386f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:24.373679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.374152 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.374261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.394272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:24.395470 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:24.428382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:24.454237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1306/2605] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:24.462200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.462489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.480299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.484828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:24.486062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:24.494085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1300/2606] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:24.498472 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.508166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fe6cb-d06b-4097-a4ad-9e3b6928c1ca None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.513552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.514148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.514425 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.514695 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.515343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:03:24.515644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.517275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:24.530088 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1307/2607] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:03:24.539660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.549087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8cde-cb6e-4f74-9789-c3728b437016 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.553862 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.554462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.554742 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.555051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.555692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.557637 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:24.757012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1301/2608] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:24 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:24.761680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.771582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b38b-cced-42a9-92bb-68cb7ae10363 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.826703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.827220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.827494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.827763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.828418 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.830380 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:24.929967 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1308/2609] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:24 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:03:24.936033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.946702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819ef86-f374-4603-abe1-2b5e190312cd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.952016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.952609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.952919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.953191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.953883 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.955497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:24.965669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1302/2610] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:24.974384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:24.985686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd83094-c882-4190-b152-47bed05ae61f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:24.991146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:24.991783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:24.992065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:24.992342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:24.993046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:24.994751 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbf81c-d6a0-43b7-bafe-2e48d04abde7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.010280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1309/2611] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:03:25.017973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.028331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f2d49-64bf-422c-b0ce-3353cbdd09cd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.033060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.033704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.033983 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.034252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] PATH_INFO: `/v3/projects/660a776be9b24650965f4cbbb3b53869/users/5b53c4ead9664d4d8337a6ec2a6a166f/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.052063 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660a776be9b24650965f4cbbb3b53869, user_id=5b53c4ead9664d4d8337a6ec2a6a166f, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.055735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.184825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1303/2612] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:25 2022] PUT /identity/v3/projects/660a776be9b24650965f4cbbb3b53869/users/5b53c4ead9664d4d8337a6ec2a6a166f/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:25.196294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.196645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.197027 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.226585 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] MFA Rules not processed for user `5b53c4ead9664d4d8337a6ec2a6a166f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:25.228185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:25.294455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1310/2613] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:25.299188 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.370557 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb05658-08c7-4665-997a-006a9752bf62 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.373031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.373639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.373911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.374177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.374806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.376927 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.525852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1304/2614] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:25 2022] POST /identity/v3/projects => generated 375 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:25.530603 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.541251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb072e4a-cde0-4a29-916f-3a4013dbde74 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.571517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:25.599096 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.599754 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.600067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.600335 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.600990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.603177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.724132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1311/2615] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:25 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:25.728393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.738968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f29cd2e-2c87-4a4e-85cc-2484f8500d16 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.743457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.744048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.744320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.744592 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.745791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.747436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.757859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1305/2616] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:25.762846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.772821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d046bda-b560-42a9-b9f7-3187e1ee6498 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.777945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.778602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.778897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.779167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] PATH_INFO: `/v3/projects/0516d1477c624ebabd5677e200b09809/users/f285448f9dc04617b5aed8329b871a67/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.794275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0516d1477c624ebabd5677e200b09809, user_id=f285448f9dc04617b5aed8329b871a67, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.796936 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.892645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1312/2617] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:25 2022] PUT /identity/v3/projects/0516d1477c624ebabd5677e200b09809/users/f285448f9dc04617b5aed8329b871a67/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:25.896690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.906986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135ec48-b8b4-4267-9b61-44e5d69b0102 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.915473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:25.963700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.964381 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.964948 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.965125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:25.965771 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:25.967386 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cfafe8-30af-4590-a422-3939277b0ffc admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:25.977578 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1306/2618] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:25.982136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:25.992822 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e84a0-2100-414c-a6d6-24b07fce6bea admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:25.998079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:25.998725 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:25.998998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:25.999264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] PATH_INFO: `/v3/projects/0516d1477c624ebabd5677e200b09809/users/f285448f9dc04617b5aed8329b871a67/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:26.001179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0516d1477c624ebabd5677e200b09809, user_id=f285448f9dc04617b5aed8329b871a67, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:26.003802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:26.014966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1313/2619] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:25 2022] PUT /identity/v3/projects/0516d1477c624ebabd5677e200b09809/users/f285448f9dc04617b5aed8329b871a67/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:26.035145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:26.035435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:26.035711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:26.065283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] MFA Rules not processed for user `f285448f9dc04617b5aed8329b871a67`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:26.066508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:26.139908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1307/2620] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:26.147709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:26.149581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:26.210984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc887d-a6d7-4dda-a6a8-c0ca32fec200 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:26.215295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:26.216077 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:26.216411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:26.217125 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:26.276564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:26.278018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:26.286913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1314/2621] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:30.520465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:30.530391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706874e-8bf2-4cc4-8e23-f81e5cbfe00e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:30.533962 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:30.534556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:30.534835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:30.535112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:30.544746 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:30.546175 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf44e58-a262-4f1c-a9b9-85f75e87aa26 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:30.555644 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1308/2622] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:33.301036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:33.302571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:33.345719 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:33.367820 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e123db1f-5c6b-495c-956b-9e040e208d12 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:33.373064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:33.373703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:33.374028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:33.374416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] PATH_INFO: `/v3/users/b78931dec878473eb6200e3bf822b51c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:33.375561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78931dec878473eb6200e3bf822b51c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:33.377560 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:33.651866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78931dec878473eb6200e3bf822b51c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:33.652681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78931dec878473eb6200e3bf822b51c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:33.653320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78931dec878473eb6200e3bf822b51c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:33.660307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78931dec878473eb6200e3bf822b51c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:33.672426 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78931dec878473eb6200e3bf822b51c'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:33.811952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1315/2623] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:33 2022] DELETE /identity/v3/users/b78931dec878473eb6200e3bf822b51c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:33.816432 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:33.816917 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:33.817187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:33.836379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:33.837619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:33.901189 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1309/2624] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:33.911570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:33.913006 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:33.970097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f56024-38b6-490a-9d19-41345325635d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:33.973861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:33.974468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:33.974744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:33.975014 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:33.984369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:33.985835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67c0ae-7915-408b-ac95-c6d4ccab6eda service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:33.995798 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1316/2625] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:34.505159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:34.506571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:34.520307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9cec6-35e3-41f1-a454-d79c2da21ec6 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:34.525117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:34.525886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:34.526293 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:34.526693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] PATH_INFO: `/v3/projects/1787b457eeb844f484c8b7b810176f0c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:34.527744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1787b457eeb844f484c8b7b810176f0c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:34.529712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:34.548059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:34.716289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1787b457eeb844f484c8b7b810176f0c', 'request_id': 'req-2b8f0349-899a-464d-b60a-fcf62d593a0b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:34.722601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1787b457eeb844f484c8b7b810176f0c', 'request_id': 'req-2b8f0349-899a-464d-b60a-fcf62d593a0b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:34.728270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1787b457eeb844f484c8b7b810176f0c', 'request_id': 'req-2b8f0349-899a-464d-b60a-fcf62d593a0b'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:34.837436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] The token cache is being invalidate because project 1787b457eeb844f484c8b7b810176f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:34.838080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:34.853844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-2b8f0349-899a-464d-b60a-fcf62d593a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:34.853844 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1310/2626] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:34 2022] DELETE /identity/v3/projects/1787b457eeb844f484c8b7b810176f0c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:34.854139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:34.854139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:34.854139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:34.866290 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:34.867484 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:34.927998 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1317/2627] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:34.936005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:34.936294 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:34.936572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:34.956846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:34.958060 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:34.966510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1311/2628] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:34.970762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:34.975572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:34.982039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbbd6f8-b87a-4b0f-b46c-17e459c77103 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:34.986915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:34.987548 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:34.987853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:34.988123 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:34.988814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:03:34.989119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:34.990747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.002452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1318/2629] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:03:35.006846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.017039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3bc08-0d95-4e52-b086-ab9b2d10aa93 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.022139 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.022729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.023006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.023275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.023900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.025833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.170743 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1312/2630] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:35 2022] POST /identity/v3/projects => generated 365 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:35.174997 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.182060 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a1209-1224-497b-9cb7-1fe5e1f53a15 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.238917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.239521 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.239799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.240074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.240702 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.242676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.380605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1319/2631] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:35 2022] POST /identity/v3/users => generated 283 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:03:35.389114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.399632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991647f-5b21-4a01-8139-23d2cee90453 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.405208 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.405808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.406084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.406376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.407017 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.408605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.420154 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1313/2632] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:35.423124 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.433649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e69555d-10ff-4563-9daf-7feea9efee1d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.439041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.439636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.439909 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.440224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.440844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.447972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f30dc-4c18-4ad8-88fc-7e62cccf27d4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.453632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1320/2633] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:35.457708 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.467856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f10fb-3c01-4053-a67b-6979e9465d83 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.472833 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.473489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.473786 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.474059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] PATH_INFO: `/v3/projects/d4504feefb894a69b10aff90c7cdd47b/users/2a6e7c3608a64cb58eaa8281bc6079c8/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.490240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4504feefb894a69b10aff90c7cdd47b, user_id=2a6e7c3608a64cb58eaa8281bc6079c8, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.492928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.597814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1314/2634] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:35 2022] PUT /identity/v3/projects/d4504feefb894a69b10aff90c7cdd47b/users/2a6e7c3608a64cb58eaa8281bc6079c8/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:35.609738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.615272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.615272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.639280 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] MFA Rules not processed for user `2a6e7c3608a64cb58eaa8281bc6079c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:35.640467 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:35.706032 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1321/2635] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:35.717878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:35.719610 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:35.778778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ac8a3-9016-4976-8da0-a9ab9d674ed5 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:35.782580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:35.783253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:35.783525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:35.783794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:35.792949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:35.794367 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315da6b-e3d9-48f2-b058-bc9193aec9b2 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:35.803128 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1315/2636] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:45.703153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=71,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:45.799037 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:46.757884 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:46.759401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:46.917130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a5bc-eeaf-4580-9146-191aeebda39d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:46.917130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:46.917130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:46.917130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:46.917857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] PATH_INFO: `/v3/users/5b53c4ead9664d4d8337a6ec2a6a166f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:46.917857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b53c4ead9664d4d8337a6ec2a6a166f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:46.917857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:47.442805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b53c4ead9664d4d8337a6ec2a6a166f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:47.443391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b53c4ead9664d4d8337a6ec2a6a166f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:47.444003 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b53c4ead9664d4d8337a6ec2a6a166f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:47.450920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b53c4ead9664d4d8337a6ec2a6a166f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:47.462513 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b53c4ead9664d4d8337a6ec2a6a166f'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:47.680229 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1322/2637] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:46 2022] DELETE /identity/v3/users/5b53c4ead9664d4d8337a6ec2a6a166f => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:47.684966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:47.685454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:47.685563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:47.716253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:47.717727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:47.777937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1316/2638] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:47.787612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:47.789048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:47.816922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:47.868908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a566ec-7e7a-4a75-b935-9282217fec8f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:47.872802 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:47.873626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:47.873844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:47.876763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:47.888565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:47.888744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:47.898382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1323/2639] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:48.372115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:48.373679 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:48.388792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba4a94-c174-439f-a2ef-b55891809ea1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:48.393817 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:48.398691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:48.398691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:48.398691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] PATH_INFO: `/v3/projects/660a776be9b24650965f4cbbb3b53869` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:48.398691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660a776be9b24650965f4cbbb3b53869)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:48.398691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:48.605226 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660a776be9b24650965f4cbbb3b53869', 'request_id': 'req-5c7b51d4-a13b-4e56-a771-33ed5d790d64'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:48.611702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660a776be9b24650965f4cbbb3b53869', 'request_id': 'req-5c7b51d4-a13b-4e56-a771-33ed5d790d64'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:48.617662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660a776be9b24650965f4cbbb3b53869', 'request_id': 'req-5c7b51d4-a13b-4e56-a771-33ed5d790d64'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:48.806148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] The token cache is being invalidate because project 660a776be9b24650965f4cbbb3b53869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:48.806909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:48.808168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:48.810046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1317/2640] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:48 2022] DELETE /identity/v3/projects/660a776be9b24650965f4cbbb3b53869 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:48.813916 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:48.823791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be32fbc-e8a4-418a-84a6-e9a93f3c86d8 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:48.886586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:48.887227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:48.887496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:48.887776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] PATH_INFO: `/v3/users/f285448f9dc04617b5aed8329b871a67` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:48.889087 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f285448f9dc04617b5aed8329b871a67)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:48.891097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:49.390662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f285448f9dc04617b5aed8329b871a67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:49.391404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f285448f9dc04617b5aed8329b871a67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:49.392025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f285448f9dc04617b5aed8329b871a67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:49.399054 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f285448f9dc04617b5aed8329b871a67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:49.411153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f285448f9dc04617b5aed8329b871a67'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:49.585298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1324/2641] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:03:48 2022] DELETE /identity/v3/users/f285448f9dc04617b5aed8329b871a67 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:50.197343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:50.199692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:50.213661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b51d4-a13b-4e56-a771-33ed5d790d64 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:50.273553 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:50.274191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:50.274465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:50.274728 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] PATH_INFO: `/v3/projects/0516d1477c624ebabd5677e200b09809` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:50.275994 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0516d1477c624ebabd5677e200b09809)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:50.278069 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:50.304581 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:50.417833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:50.426375 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:50.450063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:50.523117 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd360fc-0eb2-4e33-8955-64a00e6b4344 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:50.529341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:50.529972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:50.530251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:50.530520 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:50.532298 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:50.564081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:50.564081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb624-3934-4ef9-88b8-ba85191dc811 service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:50.564081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1325/2642] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:03:50.566014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0516d1477c624ebabd5677e200b09809', 'request_id': 'req-55f455a2-dc0b-46ba-a259-858e8e65614e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:50.576106 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0516d1477c624ebabd5677e200b09809', 'request_id': 'req-55f455a2-dc0b-46ba-a259-858e8e65614e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:50.582587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0516d1477c624ebabd5677e200b09809', 'request_id': 'req-55f455a2-dc0b-46ba-a259-858e8e65614e'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:50.800117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] The token cache is being invalidate because project 0516d1477c624ebabd5677e200b09809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:03:50.800461 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:50.801148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-55f455a2-dc0b-46ba-a259-858e8e65614e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:03:50.804779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1318/2643] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:03:50 2022] DELETE /identity/v3/projects/0516d1477c624ebabd5677e200b09809 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:50.809291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:50.809578 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:50.809851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:50.860892 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:50.862111 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:50.921944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1326/2644] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:50.931390 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:50.931689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:50.931689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:50.954661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:50.955572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:50.965963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1319/2645] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:50.970488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:50.981206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834fb25-63d7-47e8-b152-e5f694400072 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:50.986098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:50.986656 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:50.986937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:50.987227 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:50.987928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:03:50.988235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:50.989907 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.002238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1327/2646] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:03:51.006549 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:51.016031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bd428-fb44-42a5-a67f-f320de0993fe None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:51.020946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:51.021542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.021821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.022092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:51.022727 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:51.024619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.276747 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1320/2647] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:51 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:51.280880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:51.290826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789b5493-3261-44f9-ac11-51c6c2c2128f admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:51.350456 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:51.351070 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.351347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.351618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:51.352238 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:51.355343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.580658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1328/2648] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:51 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:51.593858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:51.596263 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f727848-72d6-48fe-96d6-42066c554958 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:51.600919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:51.601518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.601791 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.602058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:51.602690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:51.604859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.615040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1321/2649] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:51.619307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:51.629763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08661c8-699a-4b71-84eb-465f765a7444 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:51.634555 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:51.636233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.636514 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.636825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:51.637489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:51.639093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218b6e3e-30f3-4eb5-9ed6-d22ce5357ce0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.649170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1329/2650] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:51.654813 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:51.674138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d088eb-0482-42fd-a5b5-6e5cdf4b7ae8 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:51.674138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:51.674138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.674138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.674586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] PATH_INFO: `/v3/projects/e639b9dec7f04b3c9672437384d60f01/users/5a2a32a1531348f0ab4ba427656e1ea1/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:51.691721 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e639b9dec7f04b3c9672437384d60f01, user_id=5a2a32a1531348f0ab4ba427656e1ea1, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:51.694681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:51.969640 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1322/2651] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:51 2022] PUT /identity/v3/projects/e639b9dec7f04b3c9672437384d60f01/users/5a2a32a1531348f0ab4ba427656e1ea1/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:51.983391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:51.983894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:51.984400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.015205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] MFA Rules not processed for user `5a2a32a1531348f0ab4ba427656e1ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:52.016522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:52.101291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1330/2652] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:52.106580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:52.182523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f45a4-758c-480d-86a1-490614476437 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:52.199029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:52.199029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.199029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.199029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.199405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:52.199405 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:52.333350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1323/2653] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:52 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:03:52.337355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:52.351977 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b6eda-4d5e-4e08-b761-73f39cc63c24 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:52.421989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:52.422651 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.422928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.423200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.423830 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:52.425782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:52.637007 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1331/2654] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:52 2022] POST /identity/v3/users => generated 294 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:03:52.638805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:52.652227 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d241041-fc0f-45b9-bf3f-1f4abab36897 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:52.657879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:52.658575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.658926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.659267 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.660006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:52.661904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:52.673482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1324/2655] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:52.677855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:52.688744 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c1316-1342-4efe-9c32-93cca604c290 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:52.694491 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f5f8-7924-4e4a-bfac-8be3af53293a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:52.716011 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1332/2656] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:52.717711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:52.729058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce677e-5ba8-4a5c-b882-8290c580f009 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:52.733922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:52.734576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.734851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.735119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] PATH_INFO: `/v3/projects/50774e42f0c7416aaab4cfd0865026ed/users/f759946c28d7428180457866504eddb5/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:52.752048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50774e42f0c7416aaab4cfd0865026ed, user_id=f759946c28d7428180457866504eddb5, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:52.754806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:52.889299 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:52.966408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1325/2657] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:52 2022] PUT /identity/v3/projects/50774e42f0c7416aaab4cfd0865026ed/users/f759946c28d7428180457866504eddb5/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:52.976760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:52.977059 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:52.977341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.005482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] MFA Rules not processed for user `f759946c28d7428180457866504eddb5`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:53.006707 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:53.076386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1333/2658] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:53.080806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:53.151919 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070af4-cfde-4724-b3c6-8d846c18872f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:53.156490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:53.157115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:53.157392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:53.157663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.158286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:53.160181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:53.375559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:53.383042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1326/2659] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:03:53 2022] POST /identity/v3/projects => generated 387 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:53.387166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:53.398114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3832e-60c6-4672-b52c-937b2499994e None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:53.455658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:53.456274 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:53.456554 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:53.456889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.457530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:53.459444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:53.675606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1334/2660] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:03:53 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:03:53.685365 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:53.695820 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d39870-bae4-4c42-b78a-665453c46597 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:53.701324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:53.705364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:53.705364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:53.705364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.705364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:53.705364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:53.715979 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1327/2661] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:03:53.720496 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:53.731196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0723d-0b97-4192-ac31-769765775ef6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:53.735763 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:53.736422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:53.736700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:53.737016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] PATH_INFO: `/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5/users/349cd9cf091647c387ee2f455469a686/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.753243 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f1a1e765e94d7ca6d266679c31b4d5, user_id=349cd9cf091647c387ee2f455469a686, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:53.762808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:53.921051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1335/2662] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:53 2022] PUT /identity/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5/users/349cd9cf091647c387ee2f455469a686/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:53.925108 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:53.935039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1cfcf-e079-4fcc-a5f7-61333198fbf2 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:53.993995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:53.994907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:53.995363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:53.995788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:53.996472 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:53.999305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049a57d-c0b0-4d97-8b85-7e16964ba71d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:54.011843 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1328/2663] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:03:54.016237 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:54.027853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdc17b-f6b9-4667-8e6a-3f27ea8d1de3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:54.032653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:54.040905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:54.040905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:54.040905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] PATH_INFO: `/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5/users/349cd9cf091647c387ee2f455469a686/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:54.040905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f1a1e765e94d7ca6d266679c31b4d5, user_id=349cd9cf091647c387ee2f455469a686, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:54.040905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:54.049487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1336/2664] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:03:54 2022] PUT /identity/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5/users/349cd9cf091647c387ee2f455469a686/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:03:54.061340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:54.061630 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:54.061989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:54.090372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] MFA Rules not processed for user `349cd9cf091647c387ee2f455469a686`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:54.091597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:54.160273 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1329/2665] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:03:54.172212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:54.173888 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:54.233233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948f81-e6b9-46ca-ada3-2d435f1b158d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:54.238268 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:54.238885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:54.239164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:54.239435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:54.248897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:54.250325 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d5086-aec4-4b9e-879d-6760a28730b1 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:54.259495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1337/2666] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:54.632339 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:57.090576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:03:57.098028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:57.098028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:57.108689 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c303c-7cd2-4e24-83ca-c1ce1b58fba9 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:03:57.113768 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:03:57.114391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:57.114695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:57.114966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:57.177006 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:03:57.178456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:03:57.188704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1330/2667] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:03:57 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:03:57.694851 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:03:57.695420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:03:57.695420 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:03:57.718861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] MFA Rules not processed for user `966455cdb80745098c98e78f76c2b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:03:57.720073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:03:57.745880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:03:57.780100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1338/2668] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:03:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:03.961887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:03.970778 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce68001-0713-4eba-b5a3-43e694002833 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:03.974418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:03.975010 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:03.975289 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:03.975561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:04.035604 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:04.037158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:04.047009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1331/2669] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:08.377573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:08.380153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:08.465000 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b8cfd7-34e8-4dc1-9162-aa2e073b279a None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:08.468659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:08.469314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:08.469591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:08.469865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:08.471636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:08.539876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:08.541550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ab7682-166a-45e6-8a23-f754bb4a7318 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:08.552299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1339/2670] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:09.366694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:09.379935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6c594-7a51-42ed-9dba-99d67fc07106 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:09.386000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:09.386000 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:09.386242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:09.386516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] PATH_INFO: `/v3/users/5a2a32a1531348f0ab4ba427656e1ea1` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:09.392304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2a32a1531348f0ab4ba427656e1ea1)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:09.392304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:09.674488 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2a32a1531348f0ab4ba427656e1ea1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:09.675279 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2a32a1531348f0ab4ba427656e1ea1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:09.675942 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2a32a1531348f0ab4ba427656e1ea1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:09.797351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2a32a1531348f0ab4ba427656e1ea1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:09.805572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2a32a1531348f0ab4ba427656e1ea1'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:09.820059 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:09.826587 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1332/2671] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:09 2022] DELETE /identity/v3/users/5a2a32a1531348f0ab4ba427656e1ea1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:09.831523 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:09.832102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:09.832260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:09.852275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:09.853985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:09.922273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1340/2672] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:09.935102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:09.939525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:10.017045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb016eb5-71b3-4c14-b3e2-ff473b43fb91 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:10.020881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:10.021603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:10.021886 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:10.022157 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:10.032190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:10.033719 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:10.045366 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1333/2673] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:04:10.649577 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:10.652099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:10.671353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=100 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:10.679846 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7609b2-bf02-41d9-ba75-d15f319d36bc None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:10.690655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:10.691731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:10.692440 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:10.693202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] PATH_INFO: `/v3/projects/e639b9dec7f04b3c9672437384d60f01` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:10.694880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e639b9dec7f04b3c9672437384d60f01)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:10.697827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:10.836056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e639b9dec7f04b3c9672437384d60f01', 'request_id': 'req-15e40413-9109-4d70-b969-acc99287cddb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:10.957353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e639b9dec7f04b3c9672437384d60f01', 'request_id': 'req-15e40413-9109-4d70-b969-acc99287cddb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:10.963605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e639b9dec7f04b3c9672437384d60f01', 'request_id': 'req-15e40413-9109-4d70-b969-acc99287cddb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:10.976048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] The token cache is being invalidate because project e639b9dec7f04b3c9672437384d60f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:10.976341 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:10.977180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:10.979519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1341/2674] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:10 2022] DELETE /identity/v3/projects/e639b9dec7f04b3c9672437384d60f01 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:10.983876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:10.994877 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6307d-16fb-4ee0-aea8-7dabe9cf0172 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:11.065569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:11.067092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:11.067398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:11.067660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] PATH_INFO: `/v3/users/f759946c28d7428180457866504eddb5` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:11.068899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f759946c28d7428180457866504eddb5)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:11.072335 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:11.341124 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f759946c28d7428180457866504eddb5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:11.343310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f759946c28d7428180457866504eddb5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:11.344350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f759946c28d7428180457866504eddb5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:11.464232 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f759946c28d7428180457866504eddb5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:11.474495 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f759946c28d7428180457866504eddb5'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:11.494487 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1334/2675] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:10 2022] DELETE /identity/v3/users/f759946c28d7428180457866504eddb5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:12.320085 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:12.321626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:12.347679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e40413-9109-4d70-b969-acc99287cddb admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:12.453217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:12.455084 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:12.455362 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:12.455636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] PATH_INFO: `/v3/projects/50774e42f0c7416aaab4cfd0865026ed` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:12.457363 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50774e42f0c7416aaab4cfd0865026ed)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:12.460273 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:12.608292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50774e42f0c7416aaab4cfd0865026ed', 'request_id': 'req-95637ccc-d92c-4cfe-837d-059ba6e144b5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:12.713546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50774e42f0c7416aaab4cfd0865026ed', 'request_id': 'req-95637ccc-d92c-4cfe-837d-059ba6e144b5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:12.722098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50774e42f0c7416aaab4cfd0865026ed', 'request_id': 'req-95637ccc-d92c-4cfe-837d-059ba6e144b5'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:12.739432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] The token cache is being invalidate because project 50774e42f0c7416aaab4cfd0865026ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:12.739432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:12.739432 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:12.743258 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1342/2676] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:12 2022] DELETE /identity/v3/projects/50774e42f0c7416aaab4cfd0865026ed => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:12.748107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:12.749661 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:12.765969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77167f-ff1c-4816-a3c6-a596ba09547a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:12.830403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:12.831042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:12.831316 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:12.831582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] PATH_INFO: `/v3/users/349cd9cf091647c387ee2f455469a686` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:12.832800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=349cd9cf091647c387ee2f455469a686)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:12.834729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:13.109892 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349cd9cf091647c387ee2f455469a686'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:13.110593 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349cd9cf091647c387ee2f455469a686'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:13.111251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349cd9cf091647c387ee2f455469a686'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:13.132705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:13.207664 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349cd9cf091647c387ee2f455469a686'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:13.230336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349cd9cf091647c387ee2f455469a686'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:13.261914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1335/2677] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:12 2022] DELETE /identity/v3/users/349cd9cf091647c387ee2f455469a686 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:14.068051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:14.069292 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.091709 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637ccc-d92c-4cfe-837d-059ba6e144b5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:14.115943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:14.153876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:14.156657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.171506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:14.172160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.172875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.173489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] PATH_INFO: `/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.175069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f1a1e765e94d7ca6d266679c31b4d5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:14.177457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:14.265469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50fbbb-3d36-4c61-88c0-83bb0e147a18 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:14.270973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:14.271631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.271912 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.272184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] PATH_INFO: `/v3/users/2a6e7c3608a64cb58eaa8281bc6079c8` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.273428 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6e7c3608a64cb58eaa8281bc6079c8)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:14.275966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:14.374891 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f1a1e765e94d7ca6d266679c31b4d5', 'request_id': 'req-38448921-1589-44cd-b1fe-cb091ed719cb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.511611 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f1a1e765e94d7ca6d266679c31b4d5', 'request_id': 'req-38448921-1589-44cd-b1fe-cb091ed719cb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.519030 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f1a1e765e94d7ca6d266679c31b4d5', 'request_id': 'req-38448921-1589-44cd-b1fe-cb091ed719cb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.542923 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] The token cache is being invalidate because project 90f1a1e765e94d7ca6d266679c31b4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:14.543489 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.544361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-38448921-1589-44cd-b1fe-cb091ed719cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.546667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1343/2678] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:14 2022] DELETE /identity/v3/projects/90f1a1e765e94d7ca6d266679c31b4d5 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:14.552430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21f4-9b75-4e58-8ac5-2cac753227d5 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.553910 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21f4-9b75-4e58-8ac5-2cac753227d5 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.554345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21f4-9b75-4e58-8ac5-2cac753227d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.581016 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ed7a21f4-9b75-4e58-8ac5-2cac753227d5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:14.583390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ed7a21f4-9b75-4e58-8ac5-2cac753227d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.659559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6e7c3608a64cb58eaa8281bc6079c8'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.660345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6e7c3608a64cb58eaa8281bc6079c8'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.661065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6e7c3608a64cb58eaa8281bc6079c8'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.682799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1344/2679] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:14.692737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.698448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.698586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.718859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:14.720217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.732874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1345/2680] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:14.734281 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:14.747704 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5286a-0dcb-4c1c-bfe1-302e45ca6a3d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:14.754265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:14.754908 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.755239 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.755422 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6e7c3608a64cb58eaa8281bc6079c8'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.755545 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.756168 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:04:14.756474 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:14.758330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:14.770371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-5367b2d5-0b23-455d-9e04-cc30c648490a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6e7c3608a64cb58eaa8281bc6079c8'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:14.773557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1346/2681] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:04:14.779031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:14.798384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0746-55e1-417c-a7fc-6a09941b083a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:14.800021 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1336/2682] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:14 2022] DELETE /identity/v3/users/2a6e7c3608a64cb58eaa8281bc6079c8 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:14.801950 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd570-744a-4bca-a604-99132f513bed None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.802297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd570-744a-4bca-a604-99132f513bed None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.802676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464dd570-744a-4bca-a604-99132f513bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.832804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-464dd570-744a-4bca-a604-99132f513bed None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:14.834794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-464dd570-744a-4bca-a604-99132f513bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.885029 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:14.885572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:14.885856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:14.886194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:14.886843 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:14.888984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:14.919700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1337/2683] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:14.929769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd570-744a-4bca-a604-99132f513bed None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:14.931253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-464dd570-744a-4bca-a604-99132f513bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:14.999260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464dd570-744a-4bca-a604-99132f513bed None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.005190 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.005878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.006158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.006431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.017032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.018997 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.030147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1338/2684] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:04:15.049693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1347/2685] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:14 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:15.054141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.067334 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be3be-e83e-44f8-8a72-2b5b63d248a3 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.151787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.151787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.151787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.151787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.152250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.152250 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.276825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1339/2686] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:15 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:15.281511 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.293423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46107bfb-7ff4-4b23-a028-b9a821476eb7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.298392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.299109 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.299990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.299990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.303807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.307782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.321137 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1348/2687] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:15.325607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.340832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f8b589-d046-40f0-a001-13b1320fd6c4 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.350835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.351647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.352309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.365840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.366571 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.370933 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69c17-f144-4475-ab4c-7513f42614ae admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.393092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1340/2688] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:04:15.397342 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.410769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d71c0a-a22b-4dec-ae61-3d1b80a3f62c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.417647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.419315 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.419956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.424336 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] PATH_INFO: `/v3/projects/8f597546eb5c49238465d3586bf2c32d/users/e75c123fa82040ec92db750d62d27a47/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.445815 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f597546eb5c49238465d3586bf2c32d, user_id=e75c123fa82040ec92db750d62d27a47, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.451389 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.489111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:15.675167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1349/2689] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:15 2022] PUT /identity/v3/projects/8f597546eb5c49238465d3586bf2c32d/users/e75c123fa82040ec92db750d62d27a47/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:15.688378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.688672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.688988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.723321 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] MFA Rules not processed for user `e75c123fa82040ec92db750d62d27a47`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:15.724645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:15.796358 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1341/2690] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:15.800937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.804730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:15.807671 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:15.883857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7c07d-e2c0-4264-a995-b49217be2b58 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.889165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.890002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.890213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.890502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.891244 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.893679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:15.897165 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4df33-a98d-4f12-a7ac-216f5e13bdd1 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:15.903677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:15.904388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:15.904673 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:15.906909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] PATH_INFO: `/v3/projects/d4504feefb894a69b10aff90c7cdd47b` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:15.906909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4504feefb894a69b10aff90c7cdd47b)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:15.908278 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.101465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1350/2691] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:15 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:16.106799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.131009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4504feefb894a69b10aff90c7cdd47b', 'request_id': 'req-75da422b-5faf-4a2b-8c8e-abc76eda4c47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:16.145681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4504feefb894a69b10aff90c7cdd47b', 'request_id': 'req-75da422b-5faf-4a2b-8c8e-abc76eda4c47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:16.156468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4504feefb894a69b10aff90c7cdd47b', 'request_id': 'req-75da422b-5faf-4a2b-8c8e-abc76eda4c47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:16.204741 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e69a47-d252-4feb-9bfa-d982c0a00643 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.267043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.267649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.267927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.268197 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.268856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.270795 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.394130 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] The token cache is being invalidate because project d4504feefb894a69b10aff90c7cdd47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:16.394636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:16.395285 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-75da422b-5faf-4a2b-8c8e-abc76eda4c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:16.397193 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1342/2692] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:15 2022] DELETE /identity/v3/projects/d4504feefb894a69b10aff90c7cdd47b => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:16.402963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b751-cc24-42b4-99f8-b509171e742f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.403411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b751-cc24-42b4-99f8-b509171e742f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.403911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006b751-cc24-42b4-99f8-b509171e742f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.425652 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1351/2693] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:16 2022] POST /identity/v3/users => generated 296 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:04:16.427517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d006b751-cc24-42b4-99f8-b509171e742f None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:16.429039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d006b751-cc24-42b4-99f8-b509171e742f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:16.430113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.436582 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:16.440968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1343/2694] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:16.448143 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.449345 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.449797 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.456252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ee43f-8fe0-4e55-a80c-24276ccf63b8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.462180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.463648 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.464394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.464676 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.465459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.467149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.483971 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1352/2695] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:16.488787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.502732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04310078-22b9-4d09-afde-cfe4c1d8686e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.508849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.510412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.510760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.511105 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] PATH_INFO: `/v3/projects/a386da3381f5409cafd546f91e4a20f7/users/7826a8e569484ea2a686c84dd15158fb/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.536954 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a386da3381f5409cafd546f91e4a20f7, user_id=7826a8e569484ea2a686c84dd15158fb, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.539920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.622099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:16.647649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:16.647806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:16.647806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1353/2696] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:16 2022] PUT /identity/v3/projects/a386da3381f5409cafd546f91e4a20f7/users/7826a8e569484ea2a686c84dd15158fb/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:16.647806 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.713573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb57453-cf8a-4492-8e30-ead17d0e6d85 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.719289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.720044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.720447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.720863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.721621 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.723377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.739161 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1354/2697] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:04:16.740944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.745400 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1344/2698] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:16.749552 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.755825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7edf9-47ae-4202-9b92-8a9d99a356aa admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.761173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f5444-3c93-4942-b18a-11c709c000ca None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.762528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.763305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.763808 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.764596 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] PATH_INFO: `/v3/projects/a386da3381f5409cafd546f91e4a20f7/users/7826a8e569484ea2a686c84dd15158fb/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.766850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a386da3381f5409cafd546f91e4a20f7, user_id=7826a8e569484ea2a686c84dd15158fb, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.769895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.770700 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.772112 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.772779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.773058 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.774202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:04:16.774202 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.777101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759bcb5e-aff5-4ffc-b0f8-91c91ccdbeed admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.793497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1355/2699] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:16 2022] PUT /identity/v3/projects/a386da3381f5409cafd546f91e4a20f7/users/7826a8e569484ea2a686c84dd15158fb/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:16.800407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1345/2700] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:04:16.801685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.807618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.807973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.808684 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.842462 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] MFA Rules not processed for user `7826a8e569484ea2a686c84dd15158fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:16.843693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:16.874051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a618f-a07e-4bb6-88dc-c65cdccf384b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:16.878941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:16.879553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:16.879833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:16.880106 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:16.880835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:16.884674 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:16.915350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1346/2701] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:16.926320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:16.927678 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:17.011931 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fb1ab-90f0-4ce5-8e33-92a07dd0c2ac None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.016702 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.017339 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.017617 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.017887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.029723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.031240 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.049418 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1347/2702] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:04:17.088753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1356/2703] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:16 2022] POST /identity/v3/projects => generated 391 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:17.098470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.109465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef6636-dc55-4dfd-909c-2be6c8d69efa service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.172402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.196445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.201110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.201110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.201110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.201110 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.202527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.250825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d4ad-3dd4-4a93-92cc-de4b7aa5bdb1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.256205 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.256876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.257160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.257436 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.259314 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:17.332927 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.334332 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.347873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1357/2704] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:17.399800 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1348/2705] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:17 2022] POST /identity/v3/users => generated 296 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:17.407190 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.440212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cefef-0f31-4424-90be-a0b6cb8a47de service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.449226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.449860 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.450132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.450404 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.451047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.452664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.471355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1358/2706] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:17.475442 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.487815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac422-4e72-4eef-a292-b35dfb7cd40b admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.494643 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.495828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.496348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.496902 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.497751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.499799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426e80a-5ce1-4f3e-8d16-a9d077295fcb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.514363 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1349/2707] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:17.520353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.538442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63cff-17a3-451f-a5ce-104de79e9edb admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.544912 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.545696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.545848 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.546115 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] PATH_INFO: `/v3/projects/753ec072ac7c4b6e8dbbc63e3f0118ef/users/ce175aec43694865b2d492357020fa77/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.566708 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=753ec072ac7c4b6e8dbbc63e3f0118ef, user_id=ce175aec43694865b2d492357020fa77, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.569494 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.700382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1359/2708] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:17 2022] PUT /identity/v3/projects/753ec072ac7c4b6e8dbbc63e3f0118ef/users/ce175aec43694865b2d492357020fa77/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:17.711841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.712129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.713113 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.740910 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] MFA Rules not processed for user `ce175aec43694865b2d492357020fa77`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:17.742066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:17.808095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1350/2709] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:17.823454 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:17.825311 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:17.833993 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:17.942580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b1732-7de5-4186-b6b4-e522d237b75c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:17.949439 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:17.950711 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:17.951313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:17.951904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:17.969086 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:17.975890 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:17.983930 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1360/2710] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:18.952095 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:18.953978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:19.029034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b9d00-5d91-4835-933a-1ffc491a05f4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:19.033823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:19.034602 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:19.034952 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:19.035297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] PATH_INFO: `/v3/users/953f96dc0e2142a7b378487583c6c5e2` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:19.036522 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953f96dc0e2142a7b378487583c6c5e2)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:19.038705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:19.328371 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953f96dc0e2142a7b378487583c6c5e2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:19.328975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953f96dc0e2142a7b378487583c6c5e2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:19.329580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953f96dc0e2142a7b378487583c6c5e2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:19.348730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:19.437181 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953f96dc0e2142a7b378487583c6c5e2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:19.445591 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953f96dc0e2142a7b378487583c6c5e2'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:19.464696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1351/2711] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:18 2022] DELETE /identity/v3/users/953f96dc0e2142a7b378487583c6c5e2 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:19.814465 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:19.826929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7322a744-7c9a-486e-8ee1-ee6c0d3ae8fc service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:19.893749 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:19.899423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:19.899423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:19.899423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] PATH_INFO: `/v3/projects/c8e19e329d8144f7afe4844cc4011684` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:19.899423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e19e329d8144f7afe4844cc4011684)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:19.899423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:20.100657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e19e329d8144f7afe4844cc4011684', 'request_id': 'req-5fe499a3-b4fb-45e4-b4f9-38d202109a11'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.223435 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e19e329d8144f7afe4844cc4011684', 'request_id': 'req-5fe499a3-b4fb-45e4-b4f9-38d202109a11'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.230821 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e19e329d8144f7afe4844cc4011684', 'request_id': 'req-5fe499a3-b4fb-45e4-b4f9-38d202109a11'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.243317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] The token cache is being invalidate because project c8e19e329d8144f7afe4844cc4011684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:20.243677 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.244468 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.246082 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1361/2712] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:19 2022] DELETE /identity/v3/projects/c8e19e329d8144f7afe4844cc4011684 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:20.250911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:20.252638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:20.266307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74374832-c530-4e30-b55d-ea878e77d778 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:20.324584 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:20.325301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:20.325582 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:20.325973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] PATH_INFO: `/v3/users/12b850ab7aa04852a6e36ee00673e751` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:20.327127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b850ab7aa04852a6e36ee00673e751)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:20.329065 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:20.620741 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b850ab7aa04852a6e36ee00673e751'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.621565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b850ab7aa04852a6e36ee00673e751'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.622203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b850ab7aa04852a6e36ee00673e751'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.757270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b850ab7aa04852a6e36ee00673e751'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.766243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b850ab7aa04852a6e36ee00673e751'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:20.786019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1352/2713] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:20 2022] DELETE /identity/v3/users/12b850ab7aa04852a6e36ee00673e751 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:20.792306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:21.093678 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:21.095113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:21.121999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe499a3-b4fb-45e4-b4f9-38d202109a11 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:21.134848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:21.136224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:21.192175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:21.192680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:21.193133 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:21.193485 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] PATH_INFO: `/v3/projects/a3f9648e85a547bfa9e0584a84444873` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:21.194533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f9648e85a547bfa9e0584a84444873)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:21.197139 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:21.204290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fa9c0-4a84-4941-a6c9-3e9b2367234c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:21.209804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:21.210470 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:21.210706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:21.210978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] PATH_INFO: `/v3/users/e75c123fa82040ec92db750d62d27a47` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:21.212412 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e75c123fa82040ec92db750d62d27a47)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:21.215696 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:21.477400 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:21.492635 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e75c123fa82040ec92db750d62d27a47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.493338 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e75c123fa82040ec92db750d62d27a47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.494129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e75c123fa82040ec92db750d62d27a47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.495866 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f9648e85a547bfa9e0584a84444873', 'request_id': 'req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.720417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e75c123fa82040ec92db750d62d27a47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.728048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-51f24e46-4bb7-4787-94dc-ce0c1517492f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e75c123fa82040ec92db750d62d27a47'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.746712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1353/2714] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:21 2022] DELETE /identity/v3/users/e75c123fa82040ec92db750d62d27a47 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:21.751123 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:21.751409 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:21.751682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:21.771677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:21.772973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:21.802973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f9648e85a547bfa9e0584a84444873', 'request_id': 'req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.810286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f9648e85a547bfa9e0584a84444873', 'request_id': 'req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.823061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] The token cache is being invalidate because project a3f9648e85a547bfa9e0584a84444873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:21.823593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.824423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:21.826318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1362/2715] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:21 2022] DELETE /identity/v3/projects/a3f9648e85a547bfa9e0584a84444873 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:21.832119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1354/2716] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:21.844373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:21.845903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:21.911625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d8a17-d376-4a67-bd9f-9d2b07f9ae4b admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:21.970839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:21.970839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:21.970839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:21.970839 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:21.982224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:21.983900 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:21.997039 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1363/2717] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:22.573858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:22.577116 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:22.590590 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68d4f9-0c50-47ff-8498-bc59a26a7745 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:22.595633 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:22.596295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:22.596570 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:22.596987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] PATH_INFO: `/v3/projects/8f597546eb5c49238465d3586bf2c32d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:22.598012 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f597546eb5c49238465d3586bf2c32d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:22.599926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:22.774255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f597546eb5c49238465d3586bf2c32d', 'request_id': 'req-ee847b99-f39e-4de4-8464-4b8ada58b54a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:22.780662 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f597546eb5c49238465d3586bf2c32d', 'request_id': 'req-ee847b99-f39e-4de4-8464-4b8ada58b54a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:22.786535 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f597546eb5c49238465d3586bf2c32d', 'request_id': 'req-ee847b99-f39e-4de4-8464-4b8ada58b54a'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:22.879261 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] The token cache is being invalidate because project 8f597546eb5c49238465d3586bf2c32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:22.879555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:22.880184 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:22.881695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1355/2718] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:22 2022] DELETE /identity/v3/projects/8f597546eb5c49238465d3586bf2c32d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:22.885827 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:22.895756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dbca2-8f98-4e41-88da-6db9a95f740e service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:22.951807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:22.952431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:22.952757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:22.953038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] PATH_INFO: `/v3/users/7826a8e569484ea2a686c84dd15158fb` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:22.954167 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7826a8e569484ea2a686c84dd15158fb)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:22.956101 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:23.219171 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7826a8e569484ea2a686c84dd15158fb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:23.219831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7826a8e569484ea2a686c84dd15158fb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:23.220444 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7826a8e569484ea2a686c84dd15158fb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:23.227487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7826a8e569484ea2a686c84dd15158fb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:23.239879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b36e7f02-2d74-464b-8039-0e0d4ea2dd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7826a8e569484ea2a686c84dd15158fb'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:23.244004 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:23.360696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1364/2719] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:22 2022] DELETE /identity/v3/users/7826a8e569484ea2a686c84dd15158fb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:23.694500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=100 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:23.957947 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:23.964080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:23.973921 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847b99-f39e-4de4-8464-4b8ada58b54a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.033683 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.034435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.034712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.034975 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] PATH_INFO: `/v3/projects/a386da3381f5409cafd546f91e4a20f7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.036091 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a386da3381f5409cafd546f91e4a20f7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.038016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.123698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:24.166825 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a386da3381f5409cafd546f91e4a20f7', 'request_id': 'req-3942cc38-6963-408b-a14f-610c647d9ff9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:24.173685 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a386da3381f5409cafd546f91e4a20f7', 'request_id': 'req-3942cc38-6963-408b-a14f-610c647d9ff9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:24.179146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a386da3381f5409cafd546f91e4a20f7', 'request_id': 'req-3942cc38-6963-408b-a14f-610c647d9ff9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:24.285748 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] The token cache is being invalidate because project a386da3381f5409cafd546f91e4a20f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:24.285969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:24.286618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-3942cc38-6963-408b-a14f-610c647d9ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:24.288133 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1356/2720] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:23 2022] DELETE /identity/v3/projects/a386da3381f5409cafd546f91e4a20f7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:24.293153 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.293638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.293734 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.314233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:24.319937 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:24.374899 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1365/2721] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:24.383195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.383195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.383415 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.407478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:24.411840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:24.417936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1357/2722] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:24.422381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.431875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:24.434845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c6f38-a6bf-4e0b-90f6-690474523978 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.439110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.439710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.439983 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.440251 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.440929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:04:24.441252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.442844 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.455576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1366/2723] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:04:24.460014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.470224 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fba955-cf51-4e06-ae3e-b1c03f72f748 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.475009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.475608 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.475888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.476161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.476828 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.479542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.622519 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1358/2724] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:24 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:24.626841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.637647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478232a6-ad62-475d-a222-65e491f8d825 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.693617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.694219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.694493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.694762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.695386 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.698390 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.807104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1367/2725] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:24 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:24.811292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.822978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d0ee0-9024-4f43-bde1-9a6e0127067f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.827585 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.828170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.828440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.828752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.829439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.831042 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.841565 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1359/2726] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:24.849104 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.859344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96998682-f416-4cea-bbb6-cfcfe5b4c6b7 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.864015 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.864608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.864913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.865188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.865828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.867453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71092b5-b8b1-4703-97ac-e04b9bb98caa admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.878667 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1368/2727] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:24.882823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:24.893555 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af8fa3-a2f8-4e96-8700-8320bc38f865 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:24.898303 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:24.901292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:24.901292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:24.901292 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] PATH_INFO: `/v3/projects/511ede6dd5bf4714ba0b77d94fdbeba3/users/a0f8ec90c2d8482f993dc590725d570d/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:24.913734 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=511ede6dd5bf4714ba0b77d94fdbeba3, user_id=a0f8ec90c2d8482f993dc590725d570d, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:24.916505 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:24.997306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1360/2728] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:24 2022] PUT /identity/v3/projects/511ede6dd5bf4714ba0b77d94fdbeba3/users/a0f8ec90c2d8482f993dc590725d570d/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:25.008685 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.009150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.009424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.036347 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] MFA Rules not processed for user `a0f8ec90c2d8482f993dc590725d570d`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:25.038981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:25.101312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1369/2729] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:25.106946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.143795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:25.171408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f879973-f46e-4afc-b49e-62389d9d17eb admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.175928 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.176530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.176832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.177107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.177730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.179623 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.293609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1361/2730] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:25 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:25.303657 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.315346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005e32e-7fee-4d73-8bbe-a2515c2aac19 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.385547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.385547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.385547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.385547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.386904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.386904 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.554658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1370/2731] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:25 2022] POST /identity/v3/users => generated 301 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:25.555631 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.566907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9890be-8b28-4d22-b8d6-d580b11b921c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.571469 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.573693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.573693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.573693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.573693 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.575258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.586199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1362/2732] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:25.590919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.601572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49b64d-63a9-4855-91ed-6716deaedc9e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.607364 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.608017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.608299 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.608573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] PATH_INFO: `/v3/projects/8cabc989ede74f76ad2f27ee6e716bba/users/f35b34eb274546958432e0700245797f/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.624731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cabc989ede74f76ad2f27ee6e716bba, user_id=f35b34eb274546958432e0700245797f, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.627539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.766295 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1371/2733] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:25 2022] PUT /identity/v3/projects/8cabc989ede74f76ad2f27ee6e716bba/users/f35b34eb274546958432e0700245797f/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:25.770465 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.781417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d780f-c394-41aa-9dac-d8e251104134 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.841304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.841944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.842180 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.842453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.843102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.844794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be7cf6-612f-4ac2-a31b-dc4069ac86f7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.857148 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1363/2734] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:25.859634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:25.878853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2061cbc-c8c7-47f5-996b-6b5a7d06e5f0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:25.878853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:25.878853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.878853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.879256 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] PATH_INFO: `/v3/projects/8cabc989ede74f76ad2f27ee6e716bba/users/f35b34eb274546958432e0700245797f/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.879505 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cabc989ede74f76ad2f27ee6e716bba, user_id=f35b34eb274546958432e0700245797f, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:25.882114 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:25.893539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1372/2735] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:25 2022] PUT /identity/v3/projects/8cabc989ede74f76ad2f27ee6e716bba/users/f35b34eb274546958432e0700245797f/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:25.904866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:25.905150 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:25.905420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:25.915103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:25.932704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] MFA Rules not processed for user `f35b34eb274546958432e0700245797f`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:25.933956 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:26.003987 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1364/2736] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:25 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:26.019825 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:26.021591 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:26.080097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b0d5a-8a94-48fc-8b7d-f46c250136b1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:26.084172 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:26.084855 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:26.085135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:26.085406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:26.094859 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:26.096415 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b7146-70d2-4a72-98a7-38add49e65fe service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:26.106471 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1373/2737] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:26 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:26.266525 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:26.269645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:26.329163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f32c15-8d24-419c-92ec-ee4eb6b54d86 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:26.333782 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:26.334410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:26.334687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:26.334959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] PATH_INFO: `/v3/users/a0f8ec90c2d8482f993dc590725d570d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:26.336082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f8ec90c2d8482f993dc590725d570d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:26.338056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:26.636601 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f8ec90c2d8482f993dc590725d570d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:26.637296 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f8ec90c2d8482f993dc590725d570d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:26.637897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f8ec90c2d8482f993dc590725d570d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:26.640050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:26.722508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f8ec90c2d8482f993dc590725d570d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:26.730724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f8ec90c2d8482f993dc590725d570d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:26.748876 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1365/2738] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:26 2022] DELETE /identity/v3/users/a0f8ec90c2d8482f993dc590725d570d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:26.753320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:26.753604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:26.753876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:26.772915 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:26.774150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:26.817575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:26.832780 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1374/2739] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:26.842954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:26.844562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:26.909275 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90689bd0-8e9e-4394-9518-7eca8e7400af admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:26.920563 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:26.921212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:26.929195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:26.929195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:26.932211 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:26.933680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:26.944882 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1366/2740] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:27.160166 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:27.314498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:27.582200 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:27.584284 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:27.598406 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3817f0-8ab0-43b6-b64b-48f5555282f6 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:27.603263 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:27.604361 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:27.604645 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:27.604956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] PATH_INFO: `/v3/projects/511ede6dd5bf4714ba0b77d94fdbeba3` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:27.606481 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511ede6dd5bf4714ba0b77d94fdbeba3)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:27.608355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:27.805976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:27.823901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511ede6dd5bf4714ba0b77d94fdbeba3', 'request_id': 'req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:27.954001 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511ede6dd5bf4714ba0b77d94fdbeba3', 'request_id': 'req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:27.960346 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511ede6dd5bf4714ba0b77d94fdbeba3', 'request_id': 'req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:27.973128 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] The token cache is being invalidate because project 511ede6dd5bf4714ba0b77d94fdbeba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:27.973417 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:27.974078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:27.975589 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1375/2741] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:27 2022] DELETE /identity/v3/projects/511ede6dd5bf4714ba0b77d94fdbeba3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:27.980138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:27.989895 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd88f1-22d8-47e7-9532-4e90851e6bc3 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:28.047481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:28.048117 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:28.048394 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:28.048665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] PATH_INFO: `/v3/users/f35b34eb274546958432e0700245797f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:28.049851 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35b34eb274546958432e0700245797f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:28.051866 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:28.327885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35b34eb274546958432e0700245797f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:28.328725 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35b34eb274546958432e0700245797f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:28.329342 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35b34eb274546958432e0700245797f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:28.457086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35b34eb274546958432e0700245797f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:28.466176 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-26781463-73e8-4a74-842c-a9d1b3e1b200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35b34eb274546958432e0700245797f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:28.484605 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1367/2742] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:27 2022] DELETE /identity/v3/users/f35b34eb274546958432e0700245797f => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:29.025984 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:29.028143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:29.041733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5228a7-5bdf-4b5a-a364-36dec302f9d4 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:29.098922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:29.099595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.099873 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.100143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] PATH_INFO: `/v3/projects/8cabc989ede74f76ad2f27ee6e716bba` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.101286 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cabc989ede74f76ad2f27ee6e716bba)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:29.103196 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:29.113731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:29.239985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cabc989ede74f76ad2f27ee6e716bba', 'request_id': 'req-8174197c-3f19-4945-a221-e7d9191a5439'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:29.399452 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cabc989ede74f76ad2f27ee6e716bba', 'request_id': 'req-8174197c-3f19-4945-a221-e7d9191a5439'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:29.406271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cabc989ede74f76ad2f27ee6e716bba', 'request_id': 'req-8174197c-3f19-4945-a221-e7d9191a5439'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:29.418457 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] The token cache is being invalidate because project 8cabc989ede74f76ad2f27ee6e716bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:29.418753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:29.419394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-8174197c-3f19-4945-a221-e7d9191a5439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:29.420945 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1376/2743] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:29 2022] DELETE /identity/v3/projects/8cabc989ede74f76ad2f27ee6e716bba => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:29.425898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.426368 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.426468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.447537 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:29.448781 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:29.512031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1368/2744] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:29.580730 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.581028 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.581323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.601901 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:29.603703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:29.611968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1377/2745] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:29.616322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:29.622115 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:29.627426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790bf03-872d-4fd6-9f64-8840645387c7 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:29.635099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:29.635099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.635099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.635099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.635639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:04:29.635639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:29.636546 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:29.648236 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1369/2746] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:04:29.652760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:29.662840 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4c8ee-4309-424b-9dab-6e7acf2c3085 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:29.668094 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:29.668728 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.682487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.682487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.682487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:29.682487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:29.827886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1378/2747] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:29 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:29.831936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:29.842712 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7196fc-356c-4ce9-b6b2-bea4c6ba2ac1 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:29.899248 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:29.899759 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:29.900621 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:29.901082 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:29.901720 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:29.903648 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.123311 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1370/2748] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:29 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:30.127230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.138188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80077e68-60fb-4b54-b8dc-0f43f2c530e6 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.142720 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.143313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.143590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.143862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.144500 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.146126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.157184 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1379/2749] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:30.161336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.171795 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40146e-64d4-4f95-bd96-8cdb52e79291 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.176225 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.176837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.177114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.177378 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.178007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.179596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc9022-803c-4c40-b502-82d2170fd640 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.190477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1371/2750] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:30.199462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.209487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee714d-a6df-4f13-9114-724b802c8c81 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.215305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.215953 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.216228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.216498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] PATH_INFO: `/v3/projects/cb24509c2e384f0cbed887c61351506a/users/89d75f0996a1445a876758ea24c6fd05/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.231831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb24509c2e384f0cbed887c61351506a, user_id=89d75f0996a1445a876758ea24c6fd05, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.234714 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.354330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1380/2751] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:30 2022] PUT /identity/v3/projects/cb24509c2e384f0cbed887c61351506a/users/89d75f0996a1445a876758ea24c6fd05/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:30.364441 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.364753 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.365027 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.396014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] MFA Rules not processed for user `89d75f0996a1445a876758ea24c6fd05`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:30.397359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:30.468619 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1372/2752] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:30.473330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.539099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfdb23-e7a6-4d78-9c01-1960e943ade1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.543850 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.544453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.544755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.545033 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.545671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.547572 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.663885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1381/2753] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:30 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:30.668770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.679384 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14020a12-df8c-428a-acc8-ecf4894dfd32 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.729861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:30.735668 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.736274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.736551 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.736860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.737481 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.741255 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.792100 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.793849 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:30.806176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67403d6-258b-4cbd-8f73-33b47e81736a admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.811476 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.812095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.812372 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.812650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] PATH_INFO: `/v3/users/ce175aec43694865b2d492357020fa77` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.813791 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce175aec43694865b2d492357020fa77)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.815697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.830067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:30.869411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1373/2754] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:30 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:30.873398 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.882713 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d5357d-0af9-4db7-9bb1-1e406b33b034 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.887970 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.888541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.888861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.889138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.889766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.891395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:30.901776 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1374/2755] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:04:30.905615 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:30.914996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247a430-8248-4fbd-935e-c252d641b09e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:30.919680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:30.920350 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:30.920680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:30.920982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] PATH_INFO: `/v3/projects/8fd565bd28cc422a8f9706f8071bf76a/users/b0a4c1df162c435eae4ea67f62830270/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:30.935483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd565bd28cc422a8f9706f8071bf76a, user_id=b0a4c1df162c435eae4ea67f62830270, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:30.938206 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:31.042313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1375/2756] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:30 2022] PUT /identity/v3/projects/8fd565bd28cc422a8f9706f8071bf76a/users/b0a4c1df162c435eae4ea67f62830270/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:31.046572 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:31.071046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce175aec43694865b2d492357020fa77'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:31.071740 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce175aec43694865b2d492357020fa77'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:31.072994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce175aec43694865b2d492357020fa77'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:31.080193 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce175aec43694865b2d492357020fa77'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:31.092149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-5eb3bb74-0641-4e69-a624-b6e5a6a4fef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce175aec43694865b2d492357020fa77'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:31.110243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc68b8-939e-45d5-9d98-9472fecfcd4c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:31.114835 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:31.115528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.115881 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.116149 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.116953 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:31.118547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:31.129614 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1376/2757] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:04:31.133675 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:31.136125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.148355 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a7ab4-b0aa-4def-9191-138557804483 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:31.153416 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:31.154033 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.154309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.154579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] PATH_INFO: `/v3/projects/8fd565bd28cc422a8f9706f8071bf76a/users/b0a4c1df162c435eae4ea67f62830270/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.156489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd565bd28cc422a8f9706f8071bf76a, user_id=b0a4c1df162c435eae4ea67f62830270, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:31.159145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f4634f-a4ba-4af1-82e1-f4cf91ba87b6 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:31.169420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1377/2758] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:31 2022] PUT /identity/v3/projects/8fd565bd28cc422a8f9706f8071bf76a/users/b0a4c1df162c435eae4ea67f62830270/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:31.179268 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.179556 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.179832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.208185 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] MFA Rules not processed for user `b0a4c1df162c435eae4ea67f62830270`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:31.209420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.219370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1382/2759] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:30 2022] DELETE /identity/v3/users/ce175aec43694865b2d492357020fa77 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:04:31.223638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.223929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.224206 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.245005 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:31.246373 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.279885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1378/2760] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:31.290674 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:31.292347 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.308835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1383/2761] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:31.315283 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:31.318845 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:31.322644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.353138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8dcf43-98d6-48cd-acc1-682cc565778f None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:31.387671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb393493-6ce1-492d-b2e2-1912ac1a4c1c None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:31.391365 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:31.391982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.392257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.392526 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.402113 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:31.403565 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:31.405682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:31.406280 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.406561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.406827 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.413018 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1384/2762] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:04:31.473395 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:31.474757 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:31.485431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1379/2763] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:04:31.921731 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:31.923149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:31.939832 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898688ea-dbd6-468d-8ea3-b79af573fc8f service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:31.944646 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:31.945293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:31.945567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:31.945833 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] PATH_INFO: `/v3/projects/753ec072ac7c4b6e8dbbc63e3f0118ef` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:31.949906 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] RBAC: Authorizing `identity:delete_project(project_id=753ec072ac7c4b6e8dbbc63e3f0118ef)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:31.952705 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:32.076136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:32.077531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753ec072ac7c4b6e8dbbc63e3f0118ef', 'request_id': 'req-d7de013c-f532-4539-8bce-aa30b432110a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:32.179610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753ec072ac7c4b6e8dbbc63e3f0118ef', 'request_id': 'req-d7de013c-f532-4539-8bce-aa30b432110a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:32.186934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753ec072ac7c4b6e8dbbc63e3f0118ef', 'request_id': 'req-d7de013c-f532-4539-8bce-aa30b432110a'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:32.198533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] The token cache is being invalidate because project 753ec072ac7c4b6e8dbbc63e3f0118ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:32.198817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:32.199649 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-d7de013c-f532-4539-8bce-aa30b432110a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:32.201220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1385/2764] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:31 2022] DELETE /identity/v3/projects/753ec072ac7c4b6e8dbbc63e3f0118ef => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:33.086359 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:33.097459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3a3a1-1602-4b78-81f5-4ef389437acf service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:33.153754 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:33.154373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:33.154647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:33.154913 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] PATH_INFO: `/v3/users/89d75f0996a1445a876758ea24c6fd05` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:33.156016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89d75f0996a1445a876758ea24c6fd05)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:33.158125 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:33.309070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:33.407019 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89d75f0996a1445a876758ea24c6fd05'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:33.407704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89d75f0996a1445a876758ea24c6fd05'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:33.408438 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89d75f0996a1445a876758ea24c6fd05'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:33.519493 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89d75f0996a1445a876758ea24c6fd05'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:33.527114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89d75f0996a1445a876758ea24c6fd05'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:33.544808 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1380/2765] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:33 2022] DELETE /identity/v3/users/89d75f0996a1445a876758ea24c6fd05 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:33.549267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:33.549834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:33.549834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:33.570743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:33.572628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:33.632044 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1386/2766] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:04:33.642212 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:33.643618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:33.700807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829e46d-ff82-4e57-8597-4030322f500f admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:33.704310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:33.704938 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:33.705217 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:33.705485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:33.714452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:33.715874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:33.725247 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1381/2767] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:34.169992 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:34.171559 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:34.186549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1cfe4-ae1f-4ec8-b6a3-0187a86aa4d0 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:34.192186 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:34.192863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:34.193217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:34.193395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] PATH_INFO: `/v3/projects/cb24509c2e384f0cbed887c61351506a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:34.194622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb24509c2e384f0cbed887c61351506a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:34.197089 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:34.325488 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb24509c2e384f0cbed887c61351506a', 'request_id': 'req-bd1a8c49-45a7-444e-a426-02b3c2e75af3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.491194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb24509c2e384f0cbed887c61351506a', 'request_id': 'req-bd1a8c49-45a7-444e-a426-02b3c2e75af3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.497760 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb24509c2e384f0cbed887c61351506a', 'request_id': 'req-bd1a8c49-45a7-444e-a426-02b3c2e75af3'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.517047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] The token cache is being invalidate because project cb24509c2e384f0cbed887c61351506a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:34.517551 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.518366 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.520051 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1387/2768] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:34 2022] DELETE /identity/v3/projects/cb24509c2e384f0cbed887c61351506a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:34.524251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:34.534561 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6475-0569-46de-890b-f8678105a95b service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:34.591767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:34.592393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:34.592676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:34.592991 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] PATH_INFO: `/v3/users/b0a4c1df162c435eae4ea67f62830270` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:34.594119 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a4c1df162c435eae4ea67f62830270)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:34.596061 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:34.864986 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a4c1df162c435eae4ea67f62830270'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.865568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a4c1df162c435eae4ea67f62830270'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.866173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a4c1df162c435eae4ea67f62830270'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:34.869313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:35.008101 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a4c1df162c435eae4ea67f62830270'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:35.016598 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-8a02cd63-1709-4cb4-9980-7f204cd83d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a4c1df162c435eae4ea67f62830270'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:35.034687 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1382/2769] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:34 2022] DELETE /identity/v3/users/b0a4c1df162c435eae4ea67f62830270 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:35.630469 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:35.632570 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:35.646185 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a8c49-45a7-444e-a426-02b3c2e75af3 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:35.687612 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:35.703492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:35.704121 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:35.704397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:35.704666 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] PATH_INFO: `/v3/projects/8fd565bd28cc422a8f9706f8071bf76a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:35.705796 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd565bd28cc422a8f9706f8071bf76a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:35.707778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:35.931226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd565bd28cc422a8f9706f8071bf76a', 'request_id': 'req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:36.122072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd565bd28cc422a8f9706f8071bf76a', 'request_id': 'req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:36.128462 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd565bd28cc422a8f9706f8071bf76a', 'request_id': 'req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:36.140475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] The token cache is being invalidate because project 8fd565bd28cc422a8f9706f8071bf76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:36.140786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:36.141419 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-b097d3b9-eed6-45ad-9a5c-56a042abd7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:36.142985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1388/2770] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:35 2022] DELETE /identity/v3/projects/8fd565bd28cc422a8f9706f8071bf76a => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:36.149196 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.149730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.149887 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.170312 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:36.171527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:36.231963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1383/2771] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:36.241501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.241782 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.242057 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.262950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:36.264150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:36.272296 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1389/2772] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:36.276773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.287435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9865f-bca0-4b53-a19c-9018534a1983 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.292364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.292980 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.293254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.301413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.301413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:04:36.301413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.301413 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.308199 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1384/2773] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:04:36.312480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.322328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c8587-23d6-4cd8-8353-1296f760ae58 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.327050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.327647 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.327922 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.328218 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.328877 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.330764 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.493099 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1390/2774] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:04:36 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:36.497253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.507550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c085-705e-4ac1-8af9-a50e68ad6809 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.568304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.568936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.569216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.569484 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.570134 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.572105 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.674022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1385/2775] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:04:36 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:04:36.678155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.688655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5336537-2ba5-4962-900f-bab2b21a7269 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.693528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.693944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.694226 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.694502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.695317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.697553 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.708433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1391/2776] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:36.713114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.725382 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c55eac-ec7c-4184-8370-881f3b4fde2c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.730425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.731025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.731301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.731567 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.732209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.733959 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79214b26-14fc-4d5b-8e98-c7d6e7f61602 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.745504 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1386/2777] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:04:36.749672 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:36.760119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b67f5-8d9b-4658-a0d0-30de5e757c9d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:36.765019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:36.765665 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.765940 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.766235 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] PATH_INFO: `/v3/projects/255463d145204345834fd0520547073a/users/e186caa4d02943608cd56d11fb6f9db9/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.781587 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255463d145204345834fd0520547073a, user_id=e186caa4d02943608cd56d11fb6f9db9, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:36.784230 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:36.882540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1392/2778] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:04:36 2022] PUT /identity/v3/projects/255463d145204345834fd0520547073a/users/e186caa4d02943608cd56d11fb6f9db9/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:36.892939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:36.893223 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:36.893497 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:36.921126 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] MFA Rules not processed for user `e186caa4d02943608cd56d11fb6f9db9`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:36.922343 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:36.944152 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:36.994087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1387/2779] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:37.005092 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:37.006809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:37.068564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9617b3-39c4-426a-8a4a-05ab97046920 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:37.072586 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:37.073337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:37.073617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:37.073894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:37.083255 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:37.084743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab841-a731-485a-aadc-f3104466b962 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:37.099135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1393/2780] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:37.125107 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:37.188692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eb6516-7ae6-40f3-ae19-d7bf869dc73d None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:37.193464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:37.194203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:37.194483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:37.194766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] PATH_INFO: `/v3/users/e186caa4d02943608cd56d11fb6f9db9` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:37.195936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e186caa4d02943608cd56d11fb6f9db9)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:37.198092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:37.494694 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e186caa4d02943608cd56d11fb6f9db9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:37.495411 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e186caa4d02943608cd56d11fb6f9db9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:37.496046 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e186caa4d02943608cd56d11fb6f9db9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:37.613516 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e186caa4d02943608cd56d11fb6f9db9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:37.621085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e186caa4d02943608cd56d11fb6f9db9'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:37.639258 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1388/2781] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:04:37 2022] DELETE /identity/v3/users/e186caa4d02943608cd56d11fb6f9db9 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:37.643696 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:37.643987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:37.644262 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:37.663613 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:04:37.664865 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:37.683823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:37.725479 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1394/2782] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:04:37.735730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:37.737198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:37.784550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:37.796201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61406319-400c-465c-bc3b-d5b3d5c7b119 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:37.799891 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:37.800499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:37.800807 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:37.801127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:37.810838 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:37.812276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ec679-70a8-4f49-813b-53239337f503 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:37.822231 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1389/2783] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:04:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:04:38.477294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:04:38.477294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:04:38.477294 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5950d9-6405-4d06-9cf8-a7357432c7af None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:04:38.477592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:04:38.477592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:04:38.477592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:04:38.477592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] PATH_INFO: `/v3/projects/255463d145204345834fd0520547073a` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:04:38.478786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255463d145204345834fd0520547073a)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:04:38.479994 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:04:38.771636 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255463d145204345834fd0520547073a', 'request_id': 'req-af1c7564-2016-4f61-ab74-e8da6aa6a352'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:38.933920 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255463d145204345834fd0520547073a', 'request_id': 'req-af1c7564-2016-4f61-ab74-e8da6aa6a352'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:38.940108 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255463d145204345834fd0520547073a', 'request_id': 'req-af1c7564-2016-4f61-ab74-e8da6aa6a352'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:38.951835 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] The token cache is being invalidate because project 255463d145204345834fd0520547073a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:04:38.952530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:38.952779 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:04:38.954287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1395/2784] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:04:38 2022] DELETE /identity/v3/projects/255463d145204345834fd0520547073a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:04:48.159804 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:04:48.949023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=49,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:05:03.068855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:05:03.069372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:05:03.069483 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:05:03.088272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] MFA Rules not processed for user `966455cdb80745098c98e78f76c2b60f`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:05:03.089609 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:05:03.145051 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1390/2785] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:05:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:05:13.138288 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=25 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:05:52.869090 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:05:52.871169 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:05:52.928680 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c7564-2016-4f61-ab74-e8da6aa6a352 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:05:52.933069 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:05:52.933670 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:05:52.933944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:05:52.934212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:05:52.935917 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:05:53.026700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:05:53.028055 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:05:53.048863 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1396/2786] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:05:56.242543 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:05:56.244048 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:05:56.256897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93c669-c3ad-4779-a2c1-4b6f51123d22 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:05:56.261369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:05:56.272158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:05:56.272158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:05:56.272158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:05:56.272158 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:05:56.277681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:05:56.279087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:05:56.289695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1391/2787] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:05:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:03.046272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=66 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:06.284972 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=6 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:10.459861 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:10.461412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:10.534170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4f8bf-19b4-4fdb-9271-e5cff7f441c0 service cinder] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:10.539067 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:10.539679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:10.539959 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:10.540278 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:10.542716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:10.554073 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:10.555650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:10.566276 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1397/2788] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:10.623494 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:10.623967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:10.691380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e23c0-d46f-4a5f-974e-5c89b6b1a909 service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:10.696197 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:10.696853 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:10.697632 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:10.698066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] PATH_INFO: `/v3/users/966455cdb80745098c98e78f76c2b60f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:10.699178 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=966455cdb80745098c98e78f76c2b60f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:10.701163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:10.933841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966455cdb80745098c98e78f76c2b60f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:10.934510 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966455cdb80745098c98e78f76c2b60f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:10.935114 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966455cdb80745098c98e78f76c2b60f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.000406 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966455cdb80745098c98e78f76c2b60f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.007803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-65cdd42f-224b-4db4-9f75-e37d3ce566ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966455cdb80745098c98e78f76c2b60f'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.025453 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1392/2789] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:10 2022] DELETE /identity/v3/users/966455cdb80745098c98e78f76c2b60f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:11.263540 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:11.275422 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c132a6b-3c08-4306-b75d-05dd52be8d3b service placement] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:11.341739 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:11.342377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.342654 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.342926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] PATH_INFO: `/v3/projects/431be6e9fe9b4d86a4e13bed3115c7ae` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.344048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431be6e9fe9b4d86a4e13bed3115c7ae)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:11.345985 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:11.466590 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431be6e9fe9b4d86a4e13bed3115c7ae', 'request_id': 'req-f29ec55c-a9ed-46e1-858e-03c3e26a7640'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.549581 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431be6e9fe9b4d86a4e13bed3115c7ae', 'request_id': 'req-f29ec55c-a9ed-46e1-858e-03c3e26a7640'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.555733 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431be6e9fe9b4d86a4e13bed3115c7ae', 'request_id': 'req-f29ec55c-a9ed-46e1-858e-03c3e26a7640'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.567700 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] The token cache is being invalidate because project 431be6e9fe9b4d86a4e13bed3115c7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:11.567988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.568638 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-f29ec55c-a9ed-46e1-858e-03c3e26a7640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:11.570155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1398/2790] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:11 2022] DELETE /identity/v3/projects/431be6e9fe9b4d86a4e13bed3115c7ae => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:11.575373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.575665 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.575944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.595237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:11.596452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:11.656075 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1393/2791] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:11.664183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.664517 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.664876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.685999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:11.687212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:11.695308 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1399/2792] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:11.700216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:11.709973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94409b-d8f2-47d9-ae6b-01fc02908b74 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:11.715195 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:11.715788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.716062 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.716331 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.717004 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:06:11.717307 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:11.718904 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:11.731272 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1394/2793] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:06:11.735446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:11.744986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07fada-8f24-4e4c-9ff4-51695e6f9968 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:11.749716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:11.750313 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.750594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.750864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.751492 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:11.753427 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:11.764872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:11.877026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1400/2794] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:11 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:06:11.881233 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:11.891939 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02947798-cf07-4bd6-9212-64a70db2fd38 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:11.895642 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:11.949138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:11.949744 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:11.950025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:11.950295 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:11.950922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:11.952860 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:12.029848 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1395/2795] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:11 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:12.038165 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:12.049141 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fee0d-78ef-4851-a08d-8a7761b00c8e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:12.053784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:12.054382 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:12.054662 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:12.054934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:12.055573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:12.057321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:12.067214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1401/2796] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:12.071201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:12.081047 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fdcc0-2d8c-4935-b106-6ba0cc1f7597 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:12.086237 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:12.086822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:12.087099 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:12.087370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:12.088515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:12.090281 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d0068-f097-41cf-8eaa-2a9fb63ad1dd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:12.100988 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1396/2797] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:12.105876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:12.115925 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0840af-1491-4144-adea-93ed836b22e1 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:12.120986 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:12.121753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:12.121944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:12.122170 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] PATH_INFO: `/v3/projects/560aea6fa42d4eee887872063f9b1a42/users/2617860ff3c8457081ddc89f4d64f283/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:12.137688 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] RBAC: Authorizing `identity:create_grant(project_id=560aea6fa42d4eee887872063f9b1a42, user_id=2617860ff3c8457081ddc89f4d64f283, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:12.140328 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:12.244617 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1402/2798] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:12 2022] PUT /identity/v3/projects/560aea6fa42d4eee887872063f9b1a42/users/2617860ff3c8457081ddc89f4d64f283/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:12.255011 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:12.255298 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:12.255562 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:12.284837 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] MFA Rules not processed for user `2617860ff3c8457081ddc89f4d64f283`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:12.286043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:12.348426 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1397/2799] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:12.360023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:12.361738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:12.438257 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f027305-92d3-4664-a889-2a73f562775d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:12.443875 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:12.444506 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:12.444801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:12.445080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:12.454546 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:12.456213 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6f8cc-1628-4b8d-910b-f8c9cb1d8949 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:12.465972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1403/2800] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:18.684878 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:18.744163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff3c0-7bbe-45bb-a816-d8db7ef7216e None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:18.749376 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:18.749995 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:18.750270 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:18.750651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] PATH_INFO: `/v3/users/2617860ff3c8457081ddc89f4d64f283` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:18.751770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2617860ff3c8457081ddc89f4d64f283)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:18.753730 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:18.769903 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:18.915251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2617860ff3c8457081ddc89f4d64f283'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:18.915822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2617860ff3c8457081ddc89f4d64f283'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:18.916431 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2617860ff3c8457081ddc89f4d64f283'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:18.981499 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2617860ff3c8457081ddc89f4d64f283'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:18.989093 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2617860ff3c8457081ddc89f4d64f283'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.006403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1398/2801] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:18 2022] DELETE /identity/v3/users/2617860ff3c8457081ddc89f4d64f283 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:19.011119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.011650 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.011761 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.030396 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:19.031588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:19.091437 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1404/2802] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:19.101290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:19.102819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:19.161857 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de64fd4-0fa7-4f76-9931-bda3db69301c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:19.165638 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:19.166177 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.166454 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.166723 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.176070 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:19.177532 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c2f68-0cd4-4e5a-890d-385dbdca4859 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:19.187391 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1399/2803] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:19.602473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:19.602473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:19.621757 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d7397-5ac6-455f-9645-6f3f5675d43d None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:19.626777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:19.627531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.627811 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.628081 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] PATH_INFO: `/v3/projects/560aea6fa42d4eee887872063f9b1a42` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.629224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=560aea6fa42d4eee887872063f9b1a42)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:19.631214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:19.728567 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:19.743370 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560aea6fa42d4eee887872063f9b1a42', 'request_id': 'req-a0f6940b-2379-4143-9c15-2e67178673bf'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.809212 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560aea6fa42d4eee887872063f9b1a42', 'request_id': 'req-a0f6940b-2379-4143-9c15-2e67178673bf'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.815194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560aea6fa42d4eee887872063f9b1a42', 'request_id': 'req-a0f6940b-2379-4143-9c15-2e67178673bf'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.827429 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] The token cache is being invalidate because project 560aea6fa42d4eee887872063f9b1a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:19.827717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.828357 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-a0f6940b-2379-4143-9c15-2e67178673bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:19.829862 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1405/2804] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:19 2022] DELETE /identity/v3/projects/560aea6fa42d4eee887872063f9b1a42 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:19.834724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.835200 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.835314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.855473 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:19.856898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:19.917706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1400/2805] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:19.925583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.925869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.926143 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.945941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:19.947144 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:19.956047 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1406/2806] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:19.960203 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:19.970636 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5305e12-5aa0-45f2-908e-e88b6218bde0 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:19.975220 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:19.975821 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:19.976102 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:19.976377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:19.977068 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:06:19.977373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:19.979032 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:19.990888 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1401/2807] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:06:19.996066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.005946 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85966741-8cc3-4e56-9b63-19313f704946 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.010752 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.011941 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.012697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.012697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.013126 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.015050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.133043 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1407/2808] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:19 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:06:20.138084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.147949 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7942ff-b9dc-4622-9ad2-358cd28a9c04 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.167841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:20.203973 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.204575 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.204885 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.205160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.205779 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.207740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.283596 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1402/2809] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:20 2022] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:20.287690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.298605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee35049-e00b-40f7-a266-8b17e99d993d admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.303353 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.303950 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.304225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.304495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.305198 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.306788 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.317495 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1408/2810] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:20.321427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.331558 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eaed48-1843-418f-8a45-678f46838892 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.336144 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.336765 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.337052 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.337327 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.337967 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.339672 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb79d87-bd34-4238-9e8d-fb08d532a7ed admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.349627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1403/2811] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:20.353634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.364228 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e97ae1-5a46-4256-9093-788de2c3a1e5 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.369204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.369928 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.370204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.370473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] PATH_INFO: `/v3/projects/385e61cd9e9b4f70a5ac96c55322744c/users/a443cda612a3400894f7da56047bdbce/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.386317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385e61cd9e9b4f70a5ac96c55322744c, user_id=a443cda612a3400894f7da56047bdbce, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.389252 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.463136 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1409/2812] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:20 2022] PUT /identity/v3/projects/385e61cd9e9b4f70a5ac96c55322744c/users/a443cda612a3400894f7da56047bdbce/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:06:20.473597 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.473914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.474187 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.503485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] MFA Rules not processed for user `a443cda612a3400894f7da56047bdbce`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:20.504698 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:20.568524 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1404/2813] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:20.572881 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.635990 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6030-d2de-4ea1-a583-e11e5e18aa81 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.641604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.642204 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.642478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.642746 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.643374 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.645343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.776597 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1410/2814] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:20 2022] POST /identity/v3/projects => generated 365 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:20.781506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.792513 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8984-810c-4846-8189-dbd80348ae04 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.847869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.848547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.848770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.849045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.849670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.851573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.932056 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1405/2815] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:20 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:20.936236 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.946602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000491e-279a-4e86-8b7c-3cb5e06b7d3c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.951441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.952050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.952309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.952580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:20.953293 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:20.954879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:20.965960 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1411/2816] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:20.970084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:20.981127 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609a3ff-91b3-40e4-b3ae-2b2d6a543954 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:20.985731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:20.986372 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:20.986645 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:20.986915 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] PATH_INFO: `/v3/projects/1558077e24e24351a4ccde47414c9cc5/users/145749d54f934f64b1f41298ef20f5dd/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:21.002718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1558077e24e24351a4ccde47414c9cc5, user_id=145749d54f934f64b1f41298ef20f5dd, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:21.005388 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:21.069818 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:21.075834 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1406/2817] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:20 2022] PUT /identity/v3/projects/1558077e24e24351a4ccde47414c9cc5/users/145749d54f934f64b1f41298ef20f5dd/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:21.081179 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:21.089756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc076e02-0c5d-4487-8ef6-037664a076bf admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:21.115536 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:21.146557 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:21.147160 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:21.147438 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:21.147710 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:21.148350 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:21.149982 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff61546-3157-463a-af4f-203d538dd9a6 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:21.160588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1412/2818] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:21.164872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:21.175141 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5c26e-84ef-47fd-8fd5-a00fe478bc8c admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:21.179809 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:21.180452 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:21.180751 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:21.181028 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] PATH_INFO: `/v3/projects/1558077e24e24351a4ccde47414c9cc5/users/145749d54f934f64b1f41298ef20f5dd/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:21.182954 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1558077e24e24351a4ccde47414c9cc5, user_id=145749d54f934f64b1f41298ef20f5dd, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:21.185935 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:21.196464 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1407/2819] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:21 2022] PUT /identity/v3/projects/1558077e24e24351a4ccde47414c9cc5/users/145749d54f934f64b1f41298ef20f5dd/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:21.208786 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:21.209110 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:21.209384 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:21.239853 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] MFA Rules not processed for user `145749d54f934f64b1f41298ef20f5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:21.241122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:21.311061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1413/2820] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:21.324485 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:21.326348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:21.384612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fe37d0-45fc-4ca5-ad71-4db54c4047bf admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:21.389044 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:21.389641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:21.389916 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:21.390192 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:21.399313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:21.400766 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dcefe8-1d30-456b-9c91-42159931c228 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:21.410846 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1408/2821] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:22.363337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:22.427684 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a0dd0-c731-4bd1-b88a-59aa77edaaa7 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:22.432103 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:22.432737 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:22.433019 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:22.433288 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] PATH_INFO: `/v3/users/a443cda612a3400894f7da56047bdbce` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:22.434411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a443cda612a3400894f7da56047bdbce)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:22.436309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:22.652397 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a443cda612a3400894f7da56047bdbce'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:22.653267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a443cda612a3400894f7da56047bdbce'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:22.658317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a443cda612a3400894f7da56047bdbce'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:22.658317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:22.661326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a443cda612a3400894f7da56047bdbce'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:22.673856 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a443cda612a3400894f7da56047bdbce'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:22.780503 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1414/2822] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:22 2022] DELETE /identity/v3/users/a443cda612a3400894f7da56047bdbce => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:22.785034 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:22.785545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:22.785663 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:22.804599 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:22.805841 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:22.863680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1409/2823] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:22.874010 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:22.875480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:22.932162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461d2fa-9e64-4200-be6a-8f35b983653c admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:22.936387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:22.937022 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:22.937301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:22.937573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:22.946378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:22.947805 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:22.957312 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1415/2824] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:23.394313 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:23.395737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:23.407717 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd645f4-e04b-4d76-9a21-d14f18f38f09 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:23.412309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:23.412969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:23.413249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:23.413517 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] PATH_INFO: `/v3/projects/385e61cd9e9b4f70a5ac96c55322744c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:23.414641 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385e61cd9e9b4f70a5ac96c55322744c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:23.416547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:23.503482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385e61cd9e9b4f70a5ac96c55322744c', 'request_id': 'req-84999ed2-e915-4079-bda1-83795608fd70'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.509622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385e61cd9e9b4f70a5ac96c55322744c', 'request_id': 'req-84999ed2-e915-4079-bda1-83795608fd70'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.515269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385e61cd9e9b4f70a5ac96c55322744c', 'request_id': 'req-84999ed2-e915-4079-bda1-83795608fd70'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.591773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] The token cache is being invalidate because project 385e61cd9e9b4f70a5ac96c55322744c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:23.592064 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.592680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.594214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1410/2825] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:23 2022] DELETE /identity/v3/projects/385e61cd9e9b4f70a5ac96c55322744c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:06:23.598272 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:23.608809 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064cf7-3197-4ae8-99fb-e624786fbe33 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:23.673987 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:23.674533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:23.674838 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:23.675225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] PATH_INFO: `/v3/users/145749d54f934f64b1f41298ef20f5dd` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:23.676369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] RBAC: Authorizing `identity:delete_user(user_id=145749d54f934f64b1f41298ef20f5dd)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:23.678326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:23.900895 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '145749d54f934f64b1f41298ef20f5dd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.901575 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '145749d54f934f64b1f41298ef20f5dd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.902814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '145749d54f934f64b1f41298ef20f5dd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.909658 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '145749d54f934f64b1f41298ef20f5dd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:23.921025 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:23.922194 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-78a0c505-b6a1-4872-9b54-2798501a843c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '145749d54f934f64b1f41298ef20f5dd'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.003326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1416/2826] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:23 2022] DELETE /identity/v3/users/145749d54f934f64b1f41298ef20f5dd => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:24.437290 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:24.438676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:24.454898 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84999ed2-e915-4079-bda1-83795608fd70 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:24.463530 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:24.514612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:24.515172 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:24.515450 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:24.515726 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] PATH_INFO: `/v3/projects/1558077e24e24351a4ccde47414c9cc5` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:24.516905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1558077e24e24351a4ccde47414c9cc5)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:24.518822 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:24.678864 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1558077e24e24351a4ccde47414c9cc5', 'request_id': 'req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.685658 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1558077e24e24351a4ccde47414c9cc5', 'request_id': 'req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.691160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1558077e24e24351a4ccde47414c9cc5', 'request_id': 'req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.771274 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] The token cache is being invalidate because project 1558077e24e24351a4ccde47414c9cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:24.771496 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.772132 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d5ea62d5-815a-4d7b-b441-f8d089e9ee42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:24.773688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1411/2827] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:24 2022] DELETE /identity/v3/projects/1558077e24e24351a4ccde47414c9cc5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:24.778831 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:24.784903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:24.784903 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:24.799447 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:24.800653 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:24.859726 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1417/2828] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:24.867612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:24.867897 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:24.868173 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:24.888548 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:24.889815 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:24.897690 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1412/2829] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:24.902148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:24.912214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f0b79-b478-4563-9b61-0577eb2dd925 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:24.918919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:24.918919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:24.918919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:24.918919 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:24.919480 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:06:24.919784 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:24.921412 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:24.933041 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1418/2830] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 15:06:24.938146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:24.947626 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa81f6b-20af-4453-823a-b9a00cee57f4 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:24.952996 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:24.953162 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:24.953410 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:24.953682 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:24.954314 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:24.956253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.079669 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1413/2831] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:24 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:25.083817 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.093978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf3d4-0c09-4766-ae15-fa2b100a7086 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.150080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.150690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.150988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.151259 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.151889 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.154628 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.257620 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1419/2832] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:25 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:25.262460 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.273013 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8906e-d36e-4b83-ac5f-fac22c72df85 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.278260 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.278879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.279155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.279425 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.280066 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.281691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.291528 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1414/2833] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:25.296071 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.306083 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceef565-6e50-4d7d-b241-8068154a9215 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.310823 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.311411 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.311686 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.311952 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.312588 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.314214 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ef57-b59f-453f-918e-a29df694373b admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.324914 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1420/2834] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:25.328990 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.338718 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcbfb9-da37-4074-ba68-99c206862c49 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.343914 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.344569 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.344872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.345146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] PATH_INFO: `/v3/projects/6006aa177b604b56b2ebb1b19ad97e54/users/bf5c2fafec5d42168e369f6f82cd3ab7/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.361030 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6006aa177b604b56b2ebb1b19ad97e54, user_id=bf5c2fafec5d42168e369f6f82cd3ab7, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.363695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.440385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1415/2835] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:25 2022] PUT /identity/v3/projects/6006aa177b604b56b2ebb1b19ad97e54/users/bf5c2fafec5d42168e369f6f82cd3ab7/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:25.450876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.451155 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.451443 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.482063 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] MFA Rules not processed for user `bf5c2fafec5d42168e369f6f82cd3ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:25.483275 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:25.525773 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:25.546655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1421/2836] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:25.551242 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.594375 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:25.615251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c78c7-7cf3-48e4-bafc-93df7a7d2c0e admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.619941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.620547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.620870 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.621145 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.622023 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.623934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.731337 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1416/2837] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:25 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:25.735421 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.745956 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ff52c-4340-47e3-8cb5-ca936a3f64ed None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.802446 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.803122 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.803321 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.803594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.804233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.806183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.872441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1422/2838] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:25 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 15:06:25.876254 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.886806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6eee2-2403-4bec-a706-fd5c1a25e328 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.892168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.892936 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.893326 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.893627 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.894482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.896373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:25.908692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1417/2839] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:25.913050 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:25.923120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f161119-9337-4d47-854c-82f01ac90f59 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:25.927716 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:25.928441 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:25.928783 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:25.929056 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] PATH_INFO: `/v3/projects/82eff5cc71a74219aa733fd2bba025d5/users/82cc4f57d31f467bb842fd9906baa6ae/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:25.944326 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=82eff5cc71a74219aa733fd2bba025d5, user_id=82cc4f57d31f467bb842fd9906baa6ae, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:25.947026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:26.053285 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1423/2840] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:25 2022] PUT /identity/v3/projects/82eff5cc71a74219aa733fd2bba025d5/users/82cc4f57d31f467bb842fd9906baa6ae/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:26.057352 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:26.068568 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33d184-09fe-44f1-acbc-eb16638e7017 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:26.126660 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:26.127183 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.127463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.127736 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.128374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:26.130014 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2b941-ded2-4517-9af5-4930cdb05951 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:26.140304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1418/2841] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:26.144428 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:26.155132 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb748f-cdb0-4bb6-aa9d-d05695cd63ee admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:26.159886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:26.160549 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.160869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.161150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] PATH_INFO: `/v3/projects/82eff5cc71a74219aa733fd2bba025d5/users/82cc4f57d31f467bb842fd9906baa6ae/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.163102 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82eff5cc71a74219aa733fd2bba025d5, user_id=82cc4f57d31f467bb842fd9906baa6ae, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:26.165824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:26.176120 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1424/2842] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:26 2022] PUT /identity/v3/projects/82eff5cc71a74219aa733fd2bba025d5/users/82cc4f57d31f467bb842fd9906baa6ae/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:26.239670 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.239937 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.240214 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.268085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] MFA Rules not processed for user `82cc4f57d31f467bb842fd9906baa6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:26.269349 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:26.335770 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1419/2843] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:26.348486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:26.350320 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:26.410065 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbc179-383f-4c3c-9148-0eb1c2b92d49 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:26.413774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:26.414378 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.414659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.414934 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.424066 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:26.425529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a810505-f2fd-4418-8d96-34d73dbeac66 service cinder] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:26.435138 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1425/2844] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:26.501414 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:26.536622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:26.564482 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73b8ba-c869-44eb-a01d-259d9df099f8 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:26.569194 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:26.570096 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.570711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.571103 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] PATH_INFO: `/v3/users/bf5c2fafec5d42168e369f6f82cd3ab7` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.572301 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5c2fafec5d42168e369f6f82cd3ab7)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:26.574823 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:26.795159 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5c2fafec5d42168e369f6f82cd3ab7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:26.795735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5c2fafec5d42168e369f6f82cd3ab7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:26.796369 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5c2fafec5d42168e369f6f82cd3ab7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:26.883554 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5c2fafec5d42168e369f6f82cd3ab7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:26.891773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5c2fafec5d42168e369f6f82cd3ab7'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:26.909309 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1420/2845] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:26 2022] DELETE /identity/v3/users/bf5c2fafec5d42168e369f6f82cd3ab7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:26.913800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:26.914300 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:26.914401 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:26.934693 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:26.935871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:26.968042 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:26.992988 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1426/2846] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:27.003215 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:27.004622 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:27.063351 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9bd0-9ac5-4dba-b595-29fa053b0ba7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:27.066946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:27.067545 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:27.067819 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:27.068086 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:27.077618 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:27.079043 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:27.088905 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1421/2847] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:27.549149 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:27.550634 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:27.562958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556bce-9e78-4b01-b970-b134fd082884 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:27.567519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:27.568156 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:27.568430 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:27.568703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] PATH_INFO: `/v3/projects/6006aa177b604b56b2ebb1b19ad97e54` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:27.569847 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6006aa177b604b56b2ebb1b19ad97e54)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:27.571826 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:27.696550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6006aa177b604b56b2ebb1b19ad97e54', 'request_id': 'req-51821f35-c4ce-4ce3-932b-792f1a8d80b8'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:27.763498 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6006aa177b604b56b2ebb1b19ad97e54', 'request_id': 'req-51821f35-c4ce-4ce3-932b-792f1a8d80b8'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:27.769343 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6006aa177b604b56b2ebb1b19ad97e54', 'request_id': 'req-51821f35-c4ce-4ce3-932b-792f1a8d80b8'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:27.780882 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] The token cache is being invalidate because project 6006aa177b604b56b2ebb1b19ad97e54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:27.781178 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:27.781834 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:27.783307 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1427/2848] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:27 2022] DELETE /identity/v3/projects/6006aa177b604b56b2ebb1b19ad97e54 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:27.787370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:27.798080 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039190e-588c-49dd-8cbf-96316ae6ddff service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:27.848374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:27.855407 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:27.865982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:27.865982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:27.865982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] PATH_INFO: `/v3/users/82cc4f57d31f467bb842fd9906baa6ae` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:27.865982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cc4f57d31f467bb842fd9906baa6ae)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:27.865982 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:28.085783 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cc4f57d31f467bb842fd9906baa6ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.086445 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cc4f57d31f467bb842fd9906baa6ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.087057 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cc4f57d31f467bb842fd9906baa6ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.154534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cc4f57d31f467bb842fd9906baa6ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.162024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-1d61fb82-c63b-47d3-ad8d-674c2ff9d58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cc4f57d31f467bb842fd9906baa6ae'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.180451 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1422/2849] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:27 2022] DELETE /identity/v3/users/82cc4f57d31f467bb842fd9906baa6ae => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:28.587924 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:28.589407 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:28.602869 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51821f35-c4ce-4ce3-932b-792f1a8d80b8 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:28.660394 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:28.660778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:28.661062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:28.661337 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] PATH_INFO: `/v3/projects/82eff5cc71a74219aa733fd2bba025d5` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:28.662448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82eff5cc71a74219aa733fd2bba025d5)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:28.664354 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:28.792287 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82eff5cc71a74219aa733fd2bba025d5', 'request_id': 'req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.895093 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82eff5cc71a74219aa733fd2bba025d5', 'request_id': 'req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.901177 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82eff5cc71a74219aa733fd2bba025d5', 'request_id': 'req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.902264 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:28.913898 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] The token cache is being invalidate because project 82eff5cc71a74219aa733fd2bba025d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:28.914182 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.914816 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-c07c0f14-1e95-4118-974a-6ef4e5cc0f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:28.916395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1428/2850] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:28 2022] DELETE /identity/v3/projects/82eff5cc71a74219aa733fd2bba025d5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:28.922087 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:28.922576 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:28.922677 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:28.942151 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:28.943362 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:29.010167 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1423/2851] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:29.018097 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.018381 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.018655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.039023 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:29.041622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:29.049583 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1429/2852] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:29.053852 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.064201 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a723-2e82-4084-8dc4-e25a34c71f13 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.068830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.069430 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.069711 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.069985 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] PATH_INFO: `/v3/domains` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.070634 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88269) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:06:29.070941 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.072550 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.085009 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1424/2853] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:06:29.089605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.099301 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314f18c-6b59-4549-a3c6-a369d7d0f141 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.103894 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.104510 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.105074 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.105499 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.106929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.109302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.219502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1430/2854] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:29.223646 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.234861 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b007b-688f-442e-89c6-9dd95206c06a admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.290374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.290969 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.291244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.291509 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.292129 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.294731 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.303440 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:29.393544 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1425/2855] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:29.397387 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.408770 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38978be1-19cb-4771-916a-f9da5ffc24f0 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.413885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.414475 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.414747 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.415013 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.415643 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.417529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.427799 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1431/2856] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:29.431612 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.441542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa9db9-9674-4a30-93f8-b322f99948cc admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.446370 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.447041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.447269 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.447489 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.448122 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.450251 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1ecd9-cad2-4faf-9879-66c2c4945c1f admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.462901 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1426/2857] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:29.467769 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.477697 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac2fb5-c5a3-43dc-8e63-b197593ffe74 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.482599 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.483248 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] REQUEST_METHOD: `PUT` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.483528 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.483801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] PATH_INFO: `/v3/projects/40fc88d4525140e0a4a964fae7701328/users/aae3170462af4e6ebe9cf7059ee76344/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.497876 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40fc88d4525140e0a4a964fae7701328, user_id=aae3170462af4e6ebe9cf7059ee76344, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.500531 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.578664 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1432/2858] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:29 2022] PUT /identity/v3/projects/40fc88d4525140e0a4a964fae7701328/users/aae3170462af4e6ebe9cf7059ee76344/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:29.588926 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.589209 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.589479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.618755 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] MFA Rules not processed for user `aae3170462af4e6ebe9cf7059ee76344`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:29.619968 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:29.682707 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1427/2859] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:29.687776 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.749989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae81e7f-f0aa-4f8a-94d0-974518f51249 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.754564 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.755164 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.755442 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.755713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] PATH_INFO: `/v3/projects` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.756338 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.758285 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:29.873828 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1433/2860] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:29.878379 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:29.888840 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d0681-2545-49e8-b55d-1573ac457250 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:29.945542 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:29.946168 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:29.946436 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:29.946729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] PATH_INFO: `/v3/users` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:29.947360 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:29.949310 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.028508 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1428/2861] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:29 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:30.032616 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:30.043052 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb68745-8ff9-47ae-9d56-d7ba6f592379 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:30.048345 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:30.048981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.049265 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.049538 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.050188 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:30.051787 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.063036 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1434/2862] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:30.067045 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:30.076911 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0cf68-f1a7-4bda-999d-91e6e316ea8d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:30.081737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:30.082427 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.082697 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.082963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] PATH_INFO: `/v3/projects/0b1d5416ec0b486b8db380500b491e78/users/c01edcb0a3944e279e51f8ea0f8f8551/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.097607 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1d5416ec0b486b8db380500b491e78, user_id=c01edcb0a3944e279e51f8ea0f8f8551, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:30.100803 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.217230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1429/2863] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:30 2022] PUT /identity/v3/projects/0b1d5416ec0b486b8db380500b491e78/users/c01edcb0a3944e279e51f8ea0f8f8551/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:30.221255 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:30.231743 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980cfb-041e-4777-83af-0e07ee0b291e admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:30.287369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:30.287886 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.288163 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.288431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.289241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:30.290944 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59b150-a8b9-491d-b6e1-d230f0d049aa admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.296448 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:30.301584 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1435/2864] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:30.305773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:30.316794 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f724dd-07b5-47d3-9af2-f473b8c32d73 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:30.321478 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:30.322111 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.322385 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.322651 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] PATH_INFO: `/v3/projects/0b1d5416ec0b486b8db380500b491e78/users/c01edcb0a3944e279e51f8ea0f8f8551/roles/228b0dcdf849444fa0aff2d4bd2de87c` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.324534 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1d5416ec0b486b8db380500b491e78, user_id=c01edcb0a3944e279e51f8ea0f8f8551, role_id=228b0dcdf849444fa0aff2d4bd2de87c)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:30.327229 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.337515 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1430/2865] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:30 2022] PUT /identity/v3/projects/0b1d5416ec0b486b8db380500b491e78/users/c01edcb0a3944e279e51f8ea0f8f8551/roles/228b0dcdf849444fa0aff2d4bd2de87c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:30.349539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.349824 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.350095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.380291 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] MFA Rules not processed for user `c01edcb0a3944e279e51f8ea0f8f8551`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:30.382038 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:30.451046 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1436/2866] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:30.461900 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:30.463588 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:30.491025 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:30.522031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9ab5b-d8b2-405e-bf7a-a17f619a724d admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:30.526161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:30.526769 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:30.527380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:30.527705 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:30.543161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:30.543161 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85143b21-82b8-4bc8-9092-5d78f9aaadd4 service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:30.549216 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1431/2867] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:31.082431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:31.144344 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa9ff0-96bc-410f-8a5f-d94a22e091da None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:31.148880 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:31.149502 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:31.149774 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:31.150079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] PATH_INFO: `/v3/users/aae3170462af4e6ebe9cf7059ee76344` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:31.151233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae3170462af4e6ebe9cf7059ee76344)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:31.153176 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:31.384135 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae3170462af4e6ebe9cf7059ee76344'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:31.384872 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae3170462af4e6ebe9cf7059ee76344'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:31.385519 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae3170462af4e6ebe9cf7059ee76344'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:31.393413 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae3170462af4e6ebe9cf7059ee76344'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:31.406078 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae3170462af4e6ebe9cf7059ee76344'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:31.495897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1437/2868] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:31 2022] DELETE /identity/v3/users/aae3170462af4e6ebe9cf7059ee76344 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:31.501198 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:31.501657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:31.501777 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:31.520476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:31.522015 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:31.581506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1432/2869] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:31.591080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:31.592478 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:31.599208 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:31.652395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13e9c8-9dce-42c6-83c8-4faba07ac144 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:31.656072 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:31.656682 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:31.656991 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:31.657266 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:31.666271 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:31.667699 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:31.678175 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1438/2870] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:32.097498 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:32.099003 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:32.112796 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e26d3-2d5b-42e4-a6ec-288a06bef593 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:32.117611 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:32.118259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:32.118540 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:32.118814 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] PATH_INFO: `/v3/projects/40fc88d4525140e0a4a964fae7701328` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:32.120907 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40fc88d4525140e0a4a964fae7701328)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:32.123541 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:32.290603 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40fc88d4525140e0a4a964fae7701328', 'request_id': 'req-d42f3062-e856-4bab-bc64-dbe60c177c73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.297040 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40fc88d4525140e0a4a964fae7701328', 'request_id': 'req-d42f3062-e856-4bab-bc64-dbe60c177c73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.302506 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40fc88d4525140e0a4a964fae7701328', 'request_id': 'req-d42f3062-e856-4bab-bc64-dbe60c177c73'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.376805 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] The token cache is being invalidate because project 40fc88d4525140e0a4a964fae7701328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:32.377170 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.377752 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.379243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1433/2871] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:32 2022] DELETE /identity/v3/projects/40fc88d4525140e0a4a964fae7701328 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:32.383379 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:32.393938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c3e7a6-c62a-4434-8b00-8c48931fdc5b service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:32.448968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:32.449594 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:32.449874 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:32.450146 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] PATH_INFO: `/v3/users/c01edcb0a3944e279e51f8ea0f8f8551` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:32.451260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01edcb0a3944e279e51f8ea0f8f8551)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:32.453842 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:32.613318 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01edcb0a3944e279e51f8ea0f8f8551'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.613978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01edcb0a3944e279e51f8ea0f8f8551'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.614608 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01edcb0a3944e279e51f8ea0f8f8551'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.621541 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01edcb0a3944e279e51f8ea0f8f8551'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.633790 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-2ae5f368-ba3c-47e8-900a-632962e3fb21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01edcb0a3944e279e51f8ea0f8f8551'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:32.692147 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1439/2872] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:06:32 2022] DELETE /identity/v3/users/c01edcb0a3944e279e51f8ea0f8f8551 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 15:06:33.055681 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.057243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:33.072243 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f3062-e856-4bab-bc64-dbe60c177c73 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.121036 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:33.133392 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.134029 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.134305 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.134580 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] PATH_INFO: `/v3/projects/0b1d5416ec0b486b8db380500b491e78` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.135695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1d5416ec0b486b8db380500b491e78)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.137767 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.240230 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1d5416ec0b486b8db380500b491e78', 'request_id': 'req-eaf600c2-6368-4c93-a619-510264cdec13'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:33.246320 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1d5416ec0b486b8db380500b491e78', 'request_id': 'req-eaf600c2-6368-4c93-a619-510264cdec13'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:33.253155 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1d5416ec0b486b8db380500b491e78', 'request_id': 'req-eaf600c2-6368-4c93-a619-510264cdec13'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:33.314092 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] The token cache is being invalidate because project 0b1d5416ec0b486b8db380500b491e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88269) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:06:33.314380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:33.314989 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-eaf600c2-6368-4c93-a619-510264cdec13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:06:33.316490 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1434/2873] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:06:33 2022] DELETE /identity/v3/projects/0b1d5416ec0b486b8db380500b491e78 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:33.321453 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.321762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.322061 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.341883 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:33.343626 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:33.364687 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:33.402841 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1440/2874] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:06:33.411403 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10093e-8754-4840-833a-207b6176e723 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.411688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10093e-8754-4840-833a-207b6176e723 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.412666 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10093e-8754-4840-833a-207b6176e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.433302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-ae10093e-8754-4840-833a-207b6176e723 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:33.434501 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-ae10093e-8754-4840-833a-207b6176e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:33.442435 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1435/2875] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:06:33.446625 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.456461 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6ae6-34a0-4f48-8acf-a6e4a6392124 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.461713 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.462310 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.462624 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.462929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] PATH_INFO: `/v3/domains` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.463593 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88268) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 15:06:33.463897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.465539 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.477913 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1441/2876] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 24 15:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 15:06:33.482520 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10093e-8754-4840-833a-207b6176e723 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.494219 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10093e-8754-4840-833a-207b6176e723 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.499054 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.500026 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.500518 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.501160 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.502286 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.504239 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.597429 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1436/2877] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 24 15:06:33 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:33.601735 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.612632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b43a68-8ef1-4bfe-8e03-22629475e733 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.667938 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.668431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.668727 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.668999 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] PATH_INFO: `/v3/users` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.669606 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.672305 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.763640 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1442/2878] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 24 15:06:33 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 15:06:33.768459 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.778839 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2283ba4-6ca0-43d7-9c75-6d5067d55d30 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.784297 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.784922 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.788547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.788547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] PATH_INFO: `/v3/roles` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.788547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.788547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.798657 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1437/2879] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 15:06:33.802618 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.812732 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64183b7-c6d8-4372-918d-ef4b602f1875 admin admin] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.817377 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.817981 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.818260 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.818533 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.819180 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.821349 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118cffe-2d73-4946-b9dc-0b91c29d9a5e admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.836062 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1443/2880] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 24 15:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 15:06:33.840319 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:33.858680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f5c4e-33f9-4c62-9490-8760e192dedd admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:33.865146 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:33.865799 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.866073 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.866340 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] PATH_INFO: `/v3/projects/a2ca6ef245f6405d838d9217762f1b99/users/3ceae5e0a0f648c9be081460e075d40d/roles/268d6b86cbf444be9d29d3be41ba5e3f` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.895589 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ca6ef245f6405d838d9217762f1b99, user_id=3ceae5e0a0f648c9be081460e075d40d, role_id=268d6b86cbf444be9d29d3be41ba5e3f)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:33.898262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:33.973476 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1438/2881] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 24 15:06:33 2022] PUT /identity/v3/projects/a2ca6ef245f6405d838d9217762f1b99/users/3ceae5e0a0f648c9be081460e075d40d/roles/268d6b86cbf444be9d29d3be41ba5e3f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:06:33.978605 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31abf0-6680-42f6-b182-79dd28b4c136 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:33.978885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31abf0-6680-42f6-b182-79dd28b4c136 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:33.979158 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31abf0-6680-42f6-b182-79dd28b4c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:33.998233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-6d31abf0-6680-42f6-b182-79dd28b4c136 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:33.999522 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-6d31abf0-6680-42f6-b182-79dd28b4c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:34.057302 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1444/2882] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:34.067024 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:34.068858 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:34.126869 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3bd47-ec29-41c7-b77d-e384314c4b13 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:34.130547 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:34.131147 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:34.136477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:34.136477 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:34.141324 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:34.142773 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:34.151963 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1439/2883] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:35.399098 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cdbc-b146-4736-8264-c690c342a394 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:35.399571 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cdbc-b146-4736-8264-c690c342a394 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:35.399690 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73cdbc-b146-4736-8264-c690c342a394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:35.428905 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4c73cdbc-b146-4736-8264-c690c342a394 None None] MFA Rules not processed for user `3ceae5e0a0f648c9be081460e075d40d`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:35.430134 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4c73cdbc-b146-4736-8264-c690c342a394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:35.450242 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:35.497351 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1445/2884] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:06:35.508729 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:35.510249 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:35.531946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:35.568500 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf4ccb-5f03-4ee5-816f-08d6d208ad06 service neutron] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:35.572257 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bb596b4e1074e5d85dec4ed71dc3052', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:35.573007 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:35.573284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:35.573559 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:35.583976 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:35.585832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:35.603456 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1440/2885] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:37.243655 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] REQUEST_METHOD: `POST` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:37.244183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:37.244183 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:37.263975 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.auth.core [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] MFA Rules not processed for user `3ceae5e0a0f648c9be081460e075d40d`. Rule list: `[]` (Enabled: `True`). {{(pid=88268) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:06:37.265973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:37.272911 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1446/2886] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:06:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 15:06:45.683740 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=18 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:47.258493 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=20 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:47.349001 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:47.350433 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:47.425899 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51db44c-8099-4439-b7bc-9384e785d8ac service cinder] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:47.431471 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:47.432067 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:47.432341 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:47.432639 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:47.434357 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:47.447676 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:06:47.452259 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624fbeb-062e-41ab-a5c2-359bad1bfe30 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:06:47.460486 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1441/2887] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:06:57.456468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=34 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:06:59.963800 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:06:59.965632 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:59.988978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9c486-60ea-4432-8ef1-1102387db7f8 None None] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:06:59.988978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff851a161644ee0b97c18d2c30dc5a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:06:59.988978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:06:59.988978 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:06:59.989355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:06:59.989355 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:06:59.999561 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:00.001026 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:00.009576 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1447/2888] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:06:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:07.299121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb6c9-c198-4bf2-a20e-d8f5c6e4391d None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:07.299573 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb6c9-c198-4bf2-a20e-d8f5c6e4391d None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:07.299691 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29feb6c9-c198-4bf2-a20e-d8f5c6e4391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:07.319005 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-29feb6c9-c198-4bf2-a20e-d8f5c6e4391d None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:07.320238 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-29feb6c9-c198-4bf2-a20e-d8f5c6e4391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:07.328253 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1442/2889] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:07.343207 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:07.356966 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0426cf2-3eca-4af0-81b8-1527224c0a97 service neutron] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:07.363358 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:07.363958 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:07.364233 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:07.364530 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:07.372943 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:07.374679 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:07.384921 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1448/2890] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:11.694373 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb25c3-959f-45d2-b475-aae3bedd46d8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:11.694946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb25c3-959f-45d2-b475-aae3bedd46d8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:11.694946 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb25c3-959f-45d2-b475-aae3bedd46d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:11.715447 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e1cb25c3-959f-45d2-b475-aae3bedd46d8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:11.718647 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e1cb25c3-959f-45d2-b475-aae3bedd46d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:11.724944 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1443/2891] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:11.739482 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:11.740893 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:11.756246 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570f05d0-cee3-47ff-ad3a-083939c3abf5 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:11.761698 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:11.762309 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:11.762610 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:11.762878 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:11.771550 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:11.773162 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:11.782330 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1449/2892] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:15.126085 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81099-1066-489b-9a92-cdd0240716a5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:15.126706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81099-1066-489b-9a92-cdd0240716a5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:15.126706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a81099-1066-489b-9a92-cdd0240716a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:15.146579 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-30a81099-1066-489b-9a92-cdd0240716a5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:15.147845 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-30a81099-1066-489b-9a92-cdd0240716a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:15.155978 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1444/2893] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:15.170659 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:15.182703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc0098-9013-4ac7-9e01-62c06d2b9586 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:15.188829 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:15.189423 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:15.189701 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:15.189973 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:15.198049 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:15.199558 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:15.209130 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1450/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:18.014788 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc47f-475f-41e4-a6b6-c402d546b91b None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:18.015408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc47f-475f-41e4-a6b6-c402d546b91b None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:18.015408 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bc47f-475f-41e4-a6b6-c402d546b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:18.039393 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-e99bc47f-475f-41e4-a6b6-c402d546b91b None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:18.040629 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-e99bc47f-475f-41e4-a6b6-c402d546b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:18.049332 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1445/2895] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:18.064837 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:18.076064 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d66d3-a4ad-4bdb-8e69-085165900ef0 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:18.081619 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:18.082211 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:18.082487 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:18.082756 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:18.090801 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:18.092392 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:18.101864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1451/2896] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:21.288235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82a3f-3572-4eb1-a528-312257b67f7c None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:21.291304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82a3f-3572-4eb1-a528-312257b67f7c None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:21.291304 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a82a3f-3572-4eb1-a528-312257b67f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:21.309016 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-a0a82a3f-3572-4eb1-a528-312257b67f7c None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:21.310262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a0a82a3f-3572-4eb1-a528-312257b67f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:21.318094 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1446/2897] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:21.333508 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:21.345402 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf108d49-1d04-41f1-94d8-214c4f64a7f3 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:21.350897 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:21.351486 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:21.351762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:21.352031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:21.361174 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:21.362871 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:21.372552 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1452/2898] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:24.580474 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05779f6-dd5b-4f31-806a-4220a3a905f2 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:24.581031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05779f6-dd5b-4f31-806a-4220a3a905f2 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:24.581031 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05779f6-dd5b-4f31-806a-4220a3a905f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:24.600421 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-f05779f6-dd5b-4f31-806a-4220a3a905f2 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:24.601574 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-f05779f6-dd5b-4f31-806a-4220a3a905f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:24.610527 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1447/2899] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:24.629755 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:24.637224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52040d9b-ad3c-4d0e-830c-a52838799f7c service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:24.643219 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:24.643814 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:24.644095 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:24.644369 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:24.652388 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:24.654002 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:24.664080 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1453/2900] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:34.595284 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=18 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:07:34.659989 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=42 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:07:41.857859 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2451-5d07-4640-87a2-eff701d36dfb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:41.858348 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2451-5d07-4640-87a2-eff701d36dfb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:41.858463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f2451-5d07-4640-87a2-eff701d36dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:41.879097 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-fb2f2451-5d07-4640-87a2-eff701d36dfb None None] MFA Rules not processed for user `3ceae5e0a0f648c9be081460e075d40d`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:07:41.880302 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-fb2f2451-5d07-4640-87a2-eff701d36dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:41.887121 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1448/2901] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 24 15:07:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:07:43.506794 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:07:43.508201 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:43.578929 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea52a9a-13e6-4a2e-bcb3-d3b3f492e651 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:07:43.585885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:07:43.586864 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:07:43.587148 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:07:43.587424 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:07:43.589241 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:07:43.607145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:07:43.608777 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:07:43.619607 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1454/2902] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:07:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:07:51.872276 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=3 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:07:53.615079 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=32 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:08:02.357909 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c756-e379-4513-ad0d-7e9f1b7f86d8 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:02.359039 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c756-e379-4513-ad0d-7e9f1b7f86d8 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:02.359138 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c756-e379-4513-ad0d-7e9f1b7f86d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:02.386336 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-10e6c756-e379-4513-ad0d-7e9f1b7f86d8 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:08:02.387680 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-10e6c756-e379-4513-ad0d-7e9f1b7f86d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:02.397792 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1449/2903] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:08:02.413857 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:02.426703 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f454add-a5dd-4bb1-89f7-394a02e79989 service placement] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:02.432416 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:02.433048 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:02.433327 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:02.433595 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:02.442961 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:02.444580 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:02.454573 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1455/2904] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:05.904523 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973f2a-0ce5-4c51-b00a-bc541f6795cb None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:05.905856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973f2a-0ce5-4c51-b00a-bc541f6795cb None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:05.905856 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03973f2a-0ce5-4c51-b00a-bc541f6795cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:05.924735 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-03973f2a-0ce5-4c51-b00a-bc541f6795cb None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:08:05.928468 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-03973f2a-0ce5-4c51-b00a-bc541f6795cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:05.934022 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1450/2905] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:08:05.947762 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:05.959768 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601d04-36ee-48f8-ad4a-0fbaeea9e1da service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:05.965524 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:05.966119 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:05.966395 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:05.966681 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:05.975807 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:05.977431 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:05.987724 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1456/2906] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:08:08.829692 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801c6f-55ae-4fb5-b9da-705f2759b537 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:08.830191 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801c6f-55ae-4fb5-b9da-705f2759b537 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:08.830306 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9801c6f-55ae-4fb5-b9da-705f2759b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:08.849832 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-c9801c6f-55ae-4fb5-b9da-705f2759b537 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:08:08.851071 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-c9801c6f-55ae-4fb5-b9da-705f2759b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:08.859787 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1451/2907] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:08:08.876352 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:08.888031 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66278055-19d4-4e41-adaf-8dec67324669 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:08.894455 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:08.895045 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:08.895323 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:08.895592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:08.903671 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:08.905544 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:08.914778 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1457/2908] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:12.041764 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0b12-769a-4759-8e71-f958f96db443 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:12.042252 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0b12-769a-4759-8e71-f958f96db443 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:12.042361 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b0b12-769a-4759-8e71-f958f96db443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:12.061737 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-0b4b0b12-769a-4759-8e71-f958f96db443 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:08:12.062934 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-0b4b0b12-769a-4759-8e71-f958f96db443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:12.070908 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1452/2909] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:08:12.086547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:12.099150 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e85e6-ddad-4ce8-a2aa-62be5626953c service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:12.104604 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:12.105220 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:12.105497 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:12.106017 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:12.114283 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:12.115836 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:12.125261 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1458/2910] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:15.328380 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] REQUEST_METHOD: `POST` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:15.328824 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:15.328966 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:15.348463 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.auth.core [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] MFA Rules not processed for user `82ed3163243941a487c9161b1c295ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=88269) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 15:08:15.349695 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:15.359153 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1453/2911] 10.222.0.88 () {58 vars in 1016 bytes} [Wed Aug 24 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 15:08:15.373622 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:15.385717 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c50d9-24c8-46ee-93fe-58f0a97abb1b service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:15.391641 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:15.393297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:15.393297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:15.393297 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:15.401289 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:15.402879 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:15.412968 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1459/2912] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:25.114377 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:25.127041 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3ae2c-b9ff-4125-aa02-3cef5bafa9f5 None None] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:25.132538 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0354722e40a344e9b2196bfa7b3e00e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:25.133163 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:25.133439 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:25.133706 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:25.135420 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:25.148624 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:25.150724 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:25.163855 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1454/2913] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:25.408547 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=30 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:08:35.158287 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=21 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:08:47.602473 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:47.615224 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250e489-7c5d-46cb-96aa-234598b991a7 service nova] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:47.621738 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:47.622529 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] REQUEST_METHOD: `GET` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:47.622813 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:47.623145 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:47.625600 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.fernet_utils [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88268) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:47.637753 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:47.639459 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:47.650391 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1460/2914] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 15:08:47.757322 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:47.767704 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cc01c-0f06-4ed9-963f-2687d3df9934 service nova] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:47.772210 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:47.772955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:47.773182 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:47.773374 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] PATH_INFO: `/v3/users/3ceae5e0a0f648c9be081460e075d40d` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:47.774531 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ceae5e0a0f648c9be081460e075d40d)` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:47.776457 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:47.942830 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ceae5e0a0f648c9be081460e075d40d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:47.943479 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ceae5e0a0f648c9be081460e075d40d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:47.944084 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ceae5e0a0f648c9be081460e075d40d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.047235 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ceae5e0a0f648c9be081460e075d40d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.054872 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.notifications [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ceae5e0a0f648c9be081460e075d40d'} {{(pid=88269) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.073806 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1455/2915] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 24 15:08:47 2022] DELETE /identity/v3/users/3ceae5e0a0f648c9be081460e075d40d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:08:48.392267 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] Authenticating user token {{(pid=88268) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:48.405501 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d8711-6d76-4dee-8b94-fb83f1c148dd service placement] Validating token access rules against request {{(pid=88268) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:48.463972 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82ed3163243941a487c9161b1c295ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08e00cc0e88b4e1a866763955e5979af', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88268) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:48.464602 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:48.464926 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:48.465202 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] PATH_INFO: `/v3/projects/a2ca6ef245f6405d838d9217762f1b99` {{(pid=88268) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:48.466317 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ca6ef245f6405d838d9217762f1b99)` {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:48.468433 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] RBAC: Authorization granted {{(pid=88268) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:48.613112 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ca6ef245f6405d838d9217762f1b99', 'request_id': 'req-daf14779-db5d-497c-bba0-36d9b34a8660'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.672225 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ca6ef245f6405d838d9217762f1b99', 'request_id': 'req-daf14779-db5d-497c-bba0-36d9b34a8660'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.678217 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ca6ef245f6405d838d9217762f1b99', 'request_id': 'req-daf14779-db5d-497c-bba0-36d9b34a8660'} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.690592 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] The token cache is being invalidate because project a2ca6ef245f6405d838d9217762f1b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88268) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 15:08:48.690885 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.691525 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG keystone.notifications [None req-daf14779-db5d-497c-bba0-36d9b34a8660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88268) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 15:08:48.693053 dv-cinder-848899-4-smb devstack@keystone.service[88268]: [pid: 88268|app: 0|req: 1461/2916] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 24 15:08:48 2022] DELETE /identity/v3/projects/a2ca6ef245f6405d838d9217762f1b99 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 15:08:56.208417 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Authenticating user token {{(pid=88269) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 15:08:56.209879 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:56.280364 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d7476-b38a-4163-84d1-326a7bb087b7 admin admin] Validating token access rules against request {{(pid=88269) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 15:08:56.340586 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '776bd34229a4419495ec77bd62fb9ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c5d7e2b381046af9424801ec7cd7ee0', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88269) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 15:08:56.341262 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] REQUEST_METHOD: `GET` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 15:08:56.341649 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] SCRIPT_NAME: `/identity` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 15:08:56.341925 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88269) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 15:08:56.343688 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.fernet_utils [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88269) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 15:08:56.354874 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 15:08:56.356703 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91df43f1-e5a5-415f-9b61-e138d8e02c04 service placement] RBAC: Authorization granted {{(pid=88269) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 15:08:56.367244 dv-cinder-848899-4-smb devstack@keystone.service[88269]: [pid: 88269|app: 0|req: 1456/2917] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 24 15:08:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 15:08:58.687644 dv-cinder-848899-4-smb devstack@keystone.service[88268]: DEBUG dbcounter [-] [88268] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 15:09:06.362955 dv-cinder-848899-4-smb devstack@keystone.service[88269]: DEBUG dbcounter [-] [88269] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}